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Abstract 



Ihe present study was desigpfied as a GRE population validity study for 
roreiyn students enrolled in U.S. graduate schcx)ls. Primary interest _was in 
validity for students for jv^cm Englidi is a second language < foreign ESL sttF 
dents). Ite dbjectivos of the st^ v^re to obtain information regarding the 
tspical \4thin--d^rtre relationship of scores on the GRE General itest to 
first-year^iverage grades, _ (FYA) (a) in sanples of foreign ESL stirients that 
are heterogeneous with respect to linguistic--a^ background^ 
(b) in sd3groi^)s that are homogeneous with respect to country of origin and 
associated background variables^ arri (c) in stdxfroijjs classified according to 
relative level of English proficiency, as measured by scores on the Test of 
English as a Foreign Language (TOEFL), GRE verbal arri analytical perfor^ce 
relative to quantitative performance^ and self-reported ^glish language 
communication status. 

Ihe study was based on data for a total of 1,353 foreign ESL stxxJents and 
42 foreign ENL (Ehglish-native-languagej sttxJents from 97 graduate departments 
in 23 graduate schools. Ei^ty-six departments were primarily quantitative— 
either engineering, matlv^cience^ or econcsnics; six were bioscience depart- 
ments; and five were primarily verbal— four educatiori _ and one political 
science. More than 90 different countries were represented in the sairple. Ihe 
majority of students were from Asia. The three largest national contingents 
(students fron Ind:a, jteivsin, and Korea) accounted for_ about one half of all 
stvxients. Students were hi^y selected both in terms of quantitative ability 
in terms of English proficiency as measured by TOEEEj. 



_ 5he de^rtment-^level sanples_ were small (median_N = 12 ) . In order _ to 
obtain reliable estimates_ of within-departnent GRE/Fffi relationships, data 
for similar departments v?ere pooled. ^ and FYA variables were z-scaled 
^ department before pooling— that is, scores were e^^ressed as deviations 
f ram depanifent-li^ means in departirent standard deviation units. Primary 
eirptesis was_gi5?n to analyses based on pooled _data for the primarily quanti- 
tative departments , because representation of departments from the othe r 
fields ves limited. 

Average levels and patterns of ^/Fffi correlations based on pooled data 

for foreign ESL students fron the 86 quantitative dej^rtirents and the five 

"verbal" departitfent;s were fourd to__te conparable to levels and^ttems of 
coefficients that have been repdrted_by the Validity Studv Servj:ce (VSS) 
for a sample ccnposed primri citizens; results for. the small sanpie 

of bioscience -departments were anomalous, due probably to saitpling effects. In 
cju^titative fields, quantitative and analytical scores were the strongest 
predictors; in the verbal fields, veri^ai scores were strongest. GFUE verbal and 
TOEFL total scores had parallel patterns of validity. 



^ Stuj*y f indirgs s^ that inferences basedon GRE_ scores regarding 

the stiDsequent acadanic perfprmance of a|^licants^ especially those applying 
for admission to primarily_quantitative departments, are likely to be as*^ valid 
for foreign ESL applicants as for U.S. applicants. Questions regarding the 
corparative academic performance of u.S^ and foreign stxidents with cortparable 
(3^ scores, not addressed directly in this stvdy, call for further research. 
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Sumnary 



Tte examinee pcpjlatidn taking t±ie General Test and the sanpies used 

in staixfardizaticHi^nd (scaling) are inade \;p predominantly of UiS. 

citizens, toward whom the test is oriented educationally^ culturally, arid lin- 
guistically. HcwBver, tiie test is also taken^ foreign natiionals, the rnajor- 
ity of ^vJtoci speak English as a second language (ESL) and vtose cultural and 
educational ?'>ackgrcnjrds differ from those of U.S. examinees. 

Ih e av erage GRE quantitative performance of foreign ESb exaininees is 
fully coTparable to that of U.S. examinees in similar fields of study, but 
their average performance can the GRE verbal and analytical ability measures is 
markedly, lower^ due primarily to factors associated with their less^thaiwiat- 
ive level of "Snglish proficiency. For foreign examinees for vton English is 
the native language (mL), verbal and analytical averages are consistent vdth 
average performance cai the quantitative test. 



Stu^ Objectives 

The present stuc^ was. designed to obtain infonnatiOT regarding the 
tj^ic^ withinKiepartment re^ GRE scores ard certain English-pro- 

ficiency-related variables to first^ar average grade itYk) in selected grad- 
uate fields (a) in_ sanpies of foreign ESL students that are heterogeneous 
with respect to liaguistic-cuiturai-^ducational ted^grduixl \^riablesr ib) in 
subgrpips that are homogeneous with respect to country of origin and associ^ 
ated backgrourd_variables,_and (c) in subgroiups classified according to rela- 
tive level of "English proficiency," as defined by the foiicjwihg variables: 

o Total score of individual students on the TOEFL, the Itest of English as 

a Foreign Language (available for about two-thirds of the students) 

b ^lative Verbal Performance Index (RVPI)— the discrepancy betveen ob^ 
served GRE verbal score and that expected for U.S. GRE examinees with given 
quantitative scores, thou^t of as reflecting a type of general English profi- 
ciency deficit 

o Relative ftnalyticai Performance Index (RM#i) — the discrepancy between 
observed ana-lytic^ score and chat e::pected for U.S. examinees with given 
quantitative scores^ tho^3ht of as re:icctxng a somewhat different t^pe of Oi- 
glish proficiency than that indexed by the R^I 



9 Self-reported better contnunication in English (BGE) status \^rsus 

better communication in some other language 



Stu^^ Sanpie and Data 



•Ihe stuJy analyzed data for cohorts of foreign students, vdtntTut regard 
to visa status, v*io entered thei r respective departments in 1982-83 and 
1983-84 as &ill-tiirB students, earned a first year average, and for. v*iom 
<3® scores and information regarding country of citizenship were available. 

S-1 
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students with ^ scores f rem a test adkninistration prior to October 1981 were 
not included in the study because the analytical test changed in October 1981. 

Data v^e re obtained for 97 departments. from 23 graduate schools, Ihe co^ 
e rating schools and departments supplied first-year average (Fa) grades and 
TOElli total scores (a Ih^ also supplied information on country 

of ci tizenship, iindergraduBte origin ( U. S . versus other) j. sex and date of 
birth, if this, inform a t i on wa s not supplied ^ the student v^en registering to 
take the GRE , 

WDSt of the saitples (86 of 97) .were from. primarily quantitative depart- 
nents^ engineering (e^^ civile chemical, industrial, and mechanical), 

mathematics^ statistics, chemistry, ^^ics, corjxlter science, or econcmics. 
Six were fron biological science departnents, and 5 wiere frcm either education 
or political science departments (see text. Table 1, for detail). 

Ihe department-level samples typically were ^ite anall: ^dian 12 
(see l^le 2). _|rpwever^ across all departitents, data were available for a 

total of 1,.;^53 ESL students:, 702 frcm ciombihed engineering departments, 353 

f rom matfc-science de^rtrents and 138 from ecdrtsmics departments ^ plios 55 
from bioscience departments and 76 fron social science departirents (primarily 
ec>-ration). Data were also available for 42 students. 

Ihe sairple v^s extremely heterogeneous with respect to .national origin 
(see Table 3 suid l^le 4). Over 90 countries were represented by at least one 
stixient, but about^90 pe ESL students were accounted for by 39 

countries with five or more nationals in the stucty sarrple. 

o I*tore than two-thirds of the students (67.8 percent) were from Asia, 11 
percent were from Europe, 9 percent from the ^anericas (excluding Canada), 
7 percent from the Mideast, and about 5 percent fron Africa. 

b The three largest national contingents :vere from 'Kiwan^ _India/ arxJ Korea. 
Hiese contingents accounted for 666 of the 1,353 foreign ESL students. 

The stixJents. were hi^y selected in terms of q uant itative ability (see 

T^le 5 for detailed suittnari' of sanple characteristics). For both ESL md 
students, the GSRE guantitati^^ mean was 684— above the.ei^tieth percentile in 
the score distrilxit^ examinees. Fbr ESL students in quantity- 

tiw departments the mean analytical rueans for ESL stu- 

dents were 382 and 48(5; for the EMi students, corresponding values were 546 
and 592. 

Quantitative means were lower for bioscience and social science students 
than for those in the primarily cjsiarititative departments. However^ for ESL 
stnjdents in all areas the pattern of relative performance on the respec- 

tive S^ility measures was the same: hidiest on quantitative, lowest on verbal, 
with analytical in between. 

The ESL students v;ere hi^ily selected in terms of a^giish proficiencY as 

S-2 
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ireasurM by JK^^ t±ie total score meah> 557, for the sanple vas at approx- 
Sately the 84th fjercentile for all graduate-level TOEFL examinees. 

ifean Fffis for the ESL students, except for those in the srnall_ sanple from 
bioscience departrtients, were ccirparable to ttose reported by the GRE Validity 
Study Service JVSS) for sanples eaipbsed predaninantiy of U.S. citizens. 

o Ihe mean first^ar average (FYA) grade for all ESL students v^s 3.45 (or 
apprcKiinately B+) . Fdr_ 1,213 students from quantitative departments, the 
mean was 3.49. Ihe small i^nples of students from bioscience and social 
science departments had FBV means of 3.18 and 3.44, rei^ctively. 

______ In order to obtain general estimates of GRE/Fm reiatioiships _for forei^ 

ESL stutents (data viere not available for U.S. students), the principal analy- 
ses j^re tesed on date |^ across departments within particular fields. 
Since tte study jt^s prijterU^ trends in GRE^/FYA rela-^ 

ticnships, ahd^not with the deveiopnient of opera prediction equations, 

it vas_ ccffivenient to_ st^riardize the scores of stvjdents on each continuous 
variable^ ihcliiding the OE^ predictors. Predictor and criterion scores were 
z-scaled— that is, they were expressed as deviations from th^ respective de- 
partment means in dejBrtnent standard deviation units prior to pooling. Data 
for ^ the small sanple of ENL students were z-scaled using itearis arid, standard 
deviatiOTs for ^L students in their rei^ctive departments^ Pbbleci-saiiple 
coefficients based on the^ z-scaled variables are ecpalvalent to ^^^rages of the 

correspcoding department-level coef f icientS- ^wei^ited accordingi^^o^ size o£ 

sanple. Ihe Coefticients reported in thi& study may be thought of as egfinwfpg 
?f population "v^ues for ESL students in the grouj^ of deE>artments for vMdi 
data were pooled. 



GRE/Fm Relationships For General Sang^es of Foreign f^L Stxrients 

To determine the typical levels of GRE/Fffi correlations in general sam- 
ples of foreign ESL students in the respective fields, size^adjusted means of 
depautment-level ^^iidity coefficients were conputed for various groups of 
departments: 



a) chemical^ civile electrical, industrial, arri nechariical engineering 

departnents, respectively; all engineering departments 

b) statistics, chemistry, E*S^ics, mathematics, and ccnputer science 
departatents, respectively; all math/science departments 

c) econoKiics departments 

d) all 86 quantitative departments — (a) + (b) + (c) 

e) bioscience departments (six) 



Principal Findings 
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f) social science deparbrents (five) 



_ Hie size--aa3ustied neans of the resulting GRE;/FYR odrrelatidhs (see text, 
Tabl e 7 y for dtetail)^ exc^t th \^re 
coaparable to size-adjusted mean cajefficients t hat ha^ been reported by the 
GBE Vctlidxty Stud^ Service (\^) for sanfdes ccofosed predominantly of U.S; 
citizens. 

d For all subgrotps of quantitative d^>artinerits* GRE quantitative scores and 

^^_¥^^3^^J^^_^<^<^^^^ more hi^ily corre with F2R than were GRE 

vertel jcores.* |^r the_pooled sanple of 1^21^ students frcsn the 86 quan- 
titative departments, size-adjusted nEan_coefficients were .311, .275, and 
.097 for quantitative^ analytical, aiK^ verbsd scores > respectively. Trends 
v^re_ generally similar for engineering, matlVscience, and econdmics 
sairples. 

o Hov^ver, for the smair sttxJents f ran five social science de- 
partments, verbal scores were nret ^^id a^ qi^titatiye scores were 

least valid. Jfean_ coefficients for v erb al , ana^^cai, and quantitative 
scores v^re .253^ .184, and .116, respectively. 

d Fdr the six bioscience saitples, average cbefficierits for quantitative and 
analytical scores were of about the same nagnitude (.061 and .081^ respec- 
tively), while the verbal coefficient v^s anomalously ne^tive. 

ftaltiple regfressiOT ahaij^es were cOTiducted using z-scaied data aggre- 
gated for broader groupings of departitents^ For the quantitative departments, 
regression results for the ccnbihed sanple and those forjengiheering, math- 
science and ecdridmics subgroups were similar (see text, "Kible 8 ard related 
discussion) . 

o Ihe standard partial regressirai (beta) coefficients for quantitative, 
analytical, and verbal scores in the cdtfcined quantitative sanple were 



* In evaluating the validity coefficients obtained in this stud^ fp^ G^ an- 
alytical ability scores it is inportant to know that prior to October 1985 
users were advised by ETS not to caisider the analytical score in selective 
admission. Assuming that this advice was followed^ only verbal arid qjan- 
titative scdires were cdnsidered directly in admitting the ESL saitples, and 
y^?i^i ??lsticpship_vdt^^ to be redSjced s resulting 

restriction in range^ ^D^lytical scores, only sane "incidental" jrestric- 

tion in range would be expected J they are positively correlated with tiie 
verb*^l and quantitative scores). Hwever,. attenuating effects oh vaiidi^ due 
to restriction of range in selection should tend, to be greater for the verbal 
ard quantitative scores, than for the analytical, scores. Validity studies 
based on sanples tested after October 1985 will be necessary in order to 
evaluate the relative contribution of the three GRE measures under coriditidns 
in \diich all three were eligible for consideration in selective admission. 
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•24^ and respectively, (fhe negative beta cx)efficient for verb- 

al reflects a negligible si^pression effect.) 

o Patterns of regression v^ights for the small bioscience and scicial science 
sanples v»re ccaisistent with the patterns of validity coefficients. 

iSheh Separtmentaliy z-scaied Fm (Z^) vas regressed de^rtirBntally 
2-scaled (SE (Zgre) variafcies (Zg, Za, and Zv) in tiie carbined_ quantitative 
sanple^ aid in the engineerir^, math-science^ arii econornics saitpies, respeo- 
tiyely, only gLi£uititative_(Zq and anali'tical (Za) scores contributed sipifi- 
rantly to ^redijirticsi of Zj^. Ihe best^-wei^ted conpbsite. in the corabined 
quantitative sanple was ^.238^ ^ ,176 Za = z'i^ (predicted Z^). 

_lhis general equatioi vas tased to ccnpiSe Z^j^__fqr students in each of 
the 86 quantitative departments. The average department-level validity coef- 
ficient for this stancJard cca^» tended to be hi^er than t±e average coef- 
ficient for eitter quantitative or analytical ability considered separately 
(see i^le 9 and related discussion). 



Effects of English Proficiency on 



BegressicBi analyses based, on pooled departmentally z-scaled data were 

conducted for su^ stixJents classified according to_level of English 

proficiency^ variously defirred by (a) the relative verbal perfprnlrice irdex or 
KVPi, (b) tte relative aralytiral performance index or RAT^I^ (c) self^ 
reported better oanituhication in Ehgiii^ (SR-BCE) versus other staUjs, and (d) 
TCEFL total score, respectively (see Table 11 and related discussiOTi).** 

Interpretetion of results for classi fictions based on lCBFL_tQtal score 

was cgtplirated by the fact (a)_tiTat nBu:y students did not have TCHFL scores 
and (b) that differences in regression associated v^th "a'J^^ versus 
nonavailabilii^" of the score were madi more pronounced than those associated 
with differences in TOEFL-score level among those with TO^Ij. 

Hdi^ver^ on balance^ danitrcdJ.lng for level of English proficiency as 

defined^ the^ >^ia^es did ix>t af|)^r_tp have a c£Lear inodgrating effect cm 
tlie relaticxship betw^^ the z-^f^ed rm criteria arxi the z^scaled GBE 
scores for ESL students in any of tiie quantitative subgrou^is (see Tstle 11 and 
related disoussich) • 



* In these and suteeguent analyses , only data for students froin the 86 quanti- 
tative departments were included. 

FVPI = discrepant be^geen observed veSai _score^V, and predicted verbal 
score, VS-^ere V' _= .52 (GREH3) + 185, _ a regression equation based on cbte 
for a saitple of U.S. examinees tested during 1981-82. RM#i = discrepancy 
betweer^euiaiytica^ score, A, ard predicted analytical score, A', v^ere A' = 
.661 (GRE>-Q) + 202, based on data for the same general sairple. 
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Parallel validity ^for TOEFL and (g^ verbal , Regressican results obtained 
v4ien was regressid on Zg, Za^ arxi Zy^nerally paralleled those obtained 
\*ien z-scaied total score was substi toted for Zv. ifeitoer x^ria^ ccan- 

tritoted significantly to prediction in the primarily quantitative sanpies. 



GRE validity for Naticffial and Regional Subgroups 

Sijtide correlations between cc(r|Dpsite of z-si^ quantitative 

arxi analytical scores_ ( predicted Z'^f^, specified^^ the regression 

of Zfya an Zq and Za scores in the coibined quantitative sanpie — that is, ,238 
Zq + .lire za) were confuted Ja) for students, from ail quantitative departments 
classified by country of citizenship_(N_ > 9) and by regions defined for the 
stts^f.and (b) for students classified by both region and graduate major 
3?^?3~ttet is, engineerirg, and economics (see Icible 12 ard 

Table 13, and related discussion). 

Ihe correlation between, this ccrtpbsite axxi Z3^ tended to be reiati^^iy 
consistent for sutogroi^ defined in terms of national origin ah^/dr acadoSic 
area. Correlation^ did hot tend_ to be hi^ier for subgroups that were homo- 
geneous than for those that were heterogenedus with respict to national origin. 

6 For 20 natianai COTtingents^ >J>, the median Z'fy§/2fya coefficient 

was r =_,36y and for nine regional contingents the median was r = .34, as 
cdrtpared to the general quantitative sanpie coefficient of r « .35. 



o For 22 subgroups (by region and quantitative area) the median coefficient 
was r = .37. 



CGarparative Performance of Regicari^ Subgroups on FWV and Variatdes 

The stucfy was hot designed specifically to assess the extent to v*uch the 
average academic students from different countries or_ groups of 

countries (regions )^tended to COTSistent with tiieir a perform- 
ance. Generally speaking, an assesatent along toese lines is conplicated by 
the national diversitj' of the foreign student pppuiation, lack of consistency 
across .departments in the national anct/or_ regicml mix of enrolled, students, 
and differences in the fields of stxx3^ selectid hy various national and reg- 
ional groups. Ifente of various national or regional subgroups may hot be 
enrolled in departnents to ccatparable with rei^ct to grading standards^ 
degree of selectivity, and so on. 

Such factors coitplicate interpretatiai of ^served differences in the 
average withirHdepartirent standing of national or regional contingents as re- 
flectid in their means cai departmentally z--scaled predictors, predictive eonv- 
pdsitesy ari5/or criterion variables. 

©cploratory analyses ^were coreJucted to assess (a) differences in the 

average academic performance of students in several regiaial classifications 

S-€ 
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def ii^ for the_stiK^ and (b) the extent to v*iich the dfeerved differences in 
acadendc perfortiance terxJed to observed differences in 

performance. T[/90 paretilei analyses >^re in^ef_one involving aact|a based 
CXI (Sspartnentally z-scaled data ( irxJi eating average withinnte staiKling 

on predictor arid criterion variaH.es) and tte other involving con^risons 

based on original JYA arid C3RE scores (iridicatihg average standing on the Fffi 
criterion and the GRE scores without regard to departnent of enrollnent) . 

itesuits_ of ^ regressiCTi of on GRE scores for students in the. quan- 
titative sanfde, treated without regard to their departments of enrdllirerit^ 
paralleled alnost identically the results of the regression of on Zgre 
scores in jxx)led data for the same samfde. Means of predicted Fm values 
(Fm') were cdn|xited using the ^TOral_sairple_ equation: .0013 G^^Q^-Q + .0006 
GR&A. The correi^xanding zfya values (Z'fyal were specified by: 

.238_ ^ + .176 Za^ Btus, regianial ccnfari sons were based aci two sets of mean 
dDserved criterion scores, namely, FYA and Z^, aind the cdrres|X3rKlirig mean 
predicted criterion scores, fTft' and Z'^a, 

For t±^ nbst part^ patterns of findings regarding regiaial differences 
based on the two sets of data were consistent. For exanple, with ot© exception 
the ranking of regiaial groigis in te ntis of mean FYA was. consistent with rank- 
ing based on mean Zfya (see "teble 14 and 'Bable 15 aridi related discussion): 

o At caie extreme, students from airope had _mean Fffis of aHsroximately 3.6, 
arid they also enjoyed relatively hic^ withiixiepartment Z^ standing, 
averaging 0.2+ standard deviaticiris atobve the fbreigi eSL means for their 
respectivedepartfflents. At the other extreme^ .students f rota Africa and 
the Mdeast earned grades averaging approximately 3.3, and they were in 
departments in whidi they^ tended to perform at a lower level than other 
ESL sttdents (below average by 0-2 standard deviations). 

o For students f ran Asia, vghb accounted for sane 68 percent of ail foreign 
students in the sanple, mean F2A was approximately 3.5 ( corresporfing to 
the gr^ FXA mean for all quantitative students vathout regard to depart- 
nent) a^ Zfya neans were agproxunately 0.0. By inference^ Asian 

students tended to provide a substanticil camnon element in the regional 

mix of the res^ctive depattment-ievei sanples; both the d^artment-leyel 
(Z^) iaeans_ard the grand mean FSA reflect staDStahtlally the conpara- 
tively high Fffis earned by the Asian stixients. 

o Effects associated with department of enrollment were illustrate in data 
for students from South^rerican countries and Mexico vSlose F2A mean of 
3.4 was lower tiian the general mear^FSA of 3.5 but ^o were from depart- 
ments in which they enjoyed etove average relative standing (mean Zfya was 
+0.11). 

. Patterns of relationships betv^n mean FYAjv^rsus.meari PSA' were similar 
to those for mean Zfya versus nean Z'fya (see l^le 16 arri Figure 1, Section 
Vil, and related disoissionj. Again, the principal d^ parallelism 
in the two sets of data was associated with the South American contingent. 
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o European students had sdnev*iat .higher mean FiA and nieah Zfya than predic- 
ted from the respective general ESL (equations. . Students. from Africa and 
the Mideast^ regional grpijgs with the lowest reuiking on GE^ variables v^re 
also wu re the lowest ranked cari toth i^ Fm' ai^ irean Z ' §a . The academic 
standing of Asian stuJents tended to be consistent with expectation iDased 
on the general TSL equations. 

Ihe findings of these exploratory analyses suggest (a) that there are 
syf±einatic differences fcy world region in the average acadertdc perfonnance of 
^^^^A^_ students ^ aiid ( b ) that level of academic perfonnance of regional sub- 
groups_ tends to be generally consistent with expectation bassd on GRE s^res. 
However, the findings idiouid be thou^t of primarily as suggesting directions 
for research designed specifically to assess the possibilitY that among for- 
eign ESL _ students^ seme national or regional subgroups may _ tend to perform 
better (less well) than other subgroups with ccqparable GRE scores. 

Indications of Findings 

•ffie findings that have been reviewed permit relatively strOTig inferences 
regarding the_relatiohship between GRE scores and first-year average grades 
for foreign ESL students in quantitative fields— students enrolled in engi- 
neering, mtlv^cience, andeOTnomics programs .^_G^ relatianisMps for 
general department-level s amp les of foreign ESL students in these _quantitative 
areas e^Dpear to be quite conparable in both level and pattern to relationships 
reported for sanples of U^S. students in similar fields. 

A standard ccnpbsite of GRE quantitative and analytical scores had geher^ 
al validity for predicting relative within-department standing on the FYR 
criterion across all the quantitative areas represented: _the several engi- 
neering fields, math-science fields, and ecqnomics. Fo^_students in jthese 
fields, neither GRE verbal scores nor TOEFli total scores contributed signifi- 
cantly to_ prediction when included in a battery with GRE quantitative and 
analytical scores. 

validity of toe ste^ not affected by introducing 

control for English prof icieng^ variously _iratexed^ nor v^s j^lidity stronger 
for groins that were homogeneous than for groups that were heterogeneous with 
respect to national origin. 

In evaluating this firK3irig> it is inpprtaht to recall that the students 
in these quantitative' departrtents were hi^iLy selected in tenris of quantita- 
tive ability as measured by the GRE, and in terms of English profici as 

measured by the TOEFli. ^ey were in fields en^^Tasizing^quantitative reasOTing 
abilities and international. synixDls. ihese fields presumsfcly require carpara- 
tively low levels of general. English language verbal ccmmunication skill. The 
opposite may be true for fields suc±i as, say^ education. 

In the limited sanple of ESL students from five "verbal" departments 

(four education and one jxjlitical science), the correlation between F!^A and 

^lE verbal scores was stronger than that for either GRE quantitative or 

analytical scores. This is cxansistent with a priori ejqpectation based on 
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validx^ stucfy findings for U.S. citizens. Accordingly, it seems^ reasonable to 
hypothesize that this pattern may tend to be typical for foreign ESL sttJdents 
in primarily verbal fields. 

FinSn^ for tte si^^^ d^rtnents were not consistent with 

expectation and can be interpreted only as reflecting sairplihg effects. 

The average scores of sttxJents on the ve^l and analytical ability 
iifeasures (382 and 4S6, respectively) were more than or© standard deviation 
lower than wouLd be e:^cted for U.S. examinees with the saane quantitative 
dbiiity— the_mean guantita^^ score for foreign ESL studfents was 698, _ only 
sligfitly hic^r than the quantitative mean of 687 reported by tte Validly 
Stud^ Service (VSS) at Ere for_ math-science i^nples ccnposed prinarily^f U.S. 
citizens (with a Gra:_ verbal mean of 528). The mean Fm for foreign ESL stlF 
dents vas agprdximately 3.5 (or Bf on the grading scale enpioyedV, as compared 
to a mean of 3. A repDrted by the GRE VSS for U.S. math-science sanpies. 

Sris particular pat^ of firsiings r>aggests hot only that the foreign 
ESL students in this sainpie tended to_be '^academiceaiy sucessful" but also 
that they may have tended to receive higgler grades, on the average # than their 
U.S. cdtglterparte with core>arable scores cn the Research is needed to 

assess the ^^alidity of this inference as well as~Ehe possibili^ that the 
average ac^dpiic p^ of som regional or national emtingehts may not 

be consistent with their average perfontiance oh the GRE. 

^ With regard to the analytical measure, it is ag^in noted that scores on 
this measure presumably were hot used directly in selecting the sanpies tinder 
consideratioh in this study, viiereas scores on the quantitative and verbal 
nieasures were used directly in selection. The cbntributicii of the analytical 
measure may be overestimated sdniev*iat in the current sanpies. 

On balance, the stucty findings suggest that inferences based on OBE 
scores regarding the si4)sequent acadendc performance of foreign ESL appli-^ 
cants, especially those applying for adnassion to prinariiy gjantitative de- 
partments, are likely to be as valid as those for U.S. applicants. 
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Section I: Background 

The Graduate fiecord BcaminatiOTS (GRE) General Ttest is widely used for 
evaluating the academic qualifications of applicants for admission to grad- 
uate programs in the Uhited Stat-es., Ihe Genetal l^st traditiOTall/ has 
provicfed measures of develg)ed verbal and quantitative reasoning abilities 
(GRE verbal or GRE-V and GRE quantitative or GRE^). in 1977, the test 
restnic±ured (see Jfille^^ to include a ireasure of developed 
analytical reasoning, ebili^, a revised version of which was introduced in 
Cfctciber 1981 tsee^ for example, sre, 1985)^ There ves sone rest of 
the verbal and quantitative neasures in terms of format and time^ allotnentS/ 
no change in test ccaitent was involved. Prior to thei-Qctober 1985 test 
administratiair users- were advised n ot to consider the a nalytical score -in 
admission , 

The verbal test includes <nntoiT^, analogies, sentence ccnpletion^ arid 

reading passages or reading eomprehensioh item-types, and the quantitative 
test includes quantitative corrparisori, regular mathematics, arri data inter- 
pretatiOT itenHty^s. These verbal and cjuantitative items sanple two well- 
est2iaidied ability domains. Less is known regarding the "ability domaih(s)" 
saitpled by tiie analytical ability neasure, v*iich includes 38 analytical 
reasoning and 12_ logical reascriing (lr) item-types, both of v*iich call 
for considerable verbal processing. 

^ ?he examnee pcf^ taking the ORE General Ttest and the sanples used 

in standardizaticai a«i calibra^^ (scaling) are made i^) predoinihantly_ _ of U.S. 
citizens _ toward whom the tests are oriented educationally^ culturally^ and 
linguistically. KcTwever, the test is also taken by foreign nationals. During 
1981-82, for example, non-U.S. citizens representing nore than 14^ different 
countries^ territories, or_ other geopolitical entities made up approximately 
16 percent of the total GRE examinee population (Wilson, 1984a, ig84b). 

^t^re are large differences between the population of U.S. examinees and 
the ppE^dation of foreicpi examinees in a^rage perforiiiance bh the verbal and 
analytical. measures. The vei±>ai and analytical performance of foreign examirv- 
ees, largely iriiividuals for vfem Biglish is a second language (ESL exam- 
inees), is itarkedly lower than that of U.S. examinees, or of foreign ENL (Qi- 
glish native language) examinees. The depressed verbal performance of foreign 
ESL exanunees is attributable, primarily^ to their less-than-native levels of 
proficiency in aigiidi. 

However, E^rform^ cn the quantitative measure does not appear to 
vary vdth English language background. U.S. examinees, foreign ESL examinees, 
and foreign ENL examinees in the saite fields of stud^ tend to have similar 
quantitative itteans. rational contingents with very depressed verbal and ana- 
lytical means frequently have very hi^ quantitative means. 

^ In ^ essence , it appears ttet fcsr foreign ESL examinees GRE verbal test 

itans [indeed, all Bngli^langtiage veri^al test items) are measuring selected 
aspects of "developing ESL proficiency" rather tiian level of "de^loped verbal 
reasoning abilities," whidi the test measures, in samples of rati ve ^glish 
speakers .^Thus, pcpulation differences in level of "verbal reasoiihg ability" 
or "anaiyticaa reascm ability" cannot be inferred from observed population 
differences between U.S. vs foreign ESL examinees in test perforaence. 
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At the_sane tine, the population dlffe in verbal test perfdnnance 

represent "real" population differences in "functional ability" to E«rfonn 
ESiglish-language tasks such as those represented by the verbal and analytical 
test items under testing conditions , including tine constraints. 

Quantitative test items, on the other hand^ appear to be measuring the 

same underlying abill^es for foreig^^^ examinees as for U.S. examinees^, 

Available evidence suggests that U.S. and foreign examinees with similar GRE 
quantitative scores have similar J^?els of quantitative ability . 

Given evidence of systematic population differences lx)th in badcgrotiri 
and in test perfonnance — evidence permitting the strong inference that the 
vertel and analytical tests are not_ measuring the sane underlying "ability 
constructs" for U^S. and^orei^i exandn^^ students) ^-ques- 

tions naturally arise regarding the criterion-related or predictive validity 
of GE^ scores for menfcers of the foreign ESb sttxJent population. For exanple: 

o For irdividuals in general sanples of foreign students, how valid are ithe 
GRE score^s for predicting s^ performance on some criterion of suc- 

cess in graduate sch(^Dl ( say, first-^ar average grade, or FYA)? Are the 
^/TO^ correlations (GRE/Fm validity coefficients) for general sanples 
of foreign ESh stixients ccnparable to those logically observed for general 
samples of .students? Do GRE/FYA validity coefficients_tend to_be com- 
parable for differe(nt national contingents of foreign students? Are S'E/ 
correlations typically stronger in saitples. that are relatively honb- 
S^^^^^.^'ith ?espect to lingiiisticHrultural^e^ background vari- 

ables (for exanple, sarples f rotn specific countries or from countries 

judged to be similar with respect to language, culture, or educational 

sj^tems) than in heterogeneous sanples? Is criterigi-reiated ^iidi^ 
typically hi^er in sanples of foreign ESb stiriehts with "hi^er levels of 
English proficiency" than for those with "lower levels of English 
proficiency?" 

b How closely does relative criterion_ stardlng of \^rious national cdntin^ 
gents correspoiid to their relative standing on (3^ predictive conposites 
developed for general ESL sanples? Do_ stuJents with more "ESL proficien- 
cy," tend to outperform students with less "ESL proficiency"— for exSt^e, 
do they tend to earn higher nean F2R than would be expected for foreign 
ESL exandnees generally, have similar GRE scores? Within the popula- 
tion of foreign ESL student do _satte mtional-linguistic subgroups tend 
to earn hi^er average grades than would be expected for foreign ESL stu- 
dents generally, viho have similar scores? 



Hhe Present Stucty 

Se present stu^ v^ validity stuc^ for 

forei^ ESL students, it was primarily concerned with obtaining and eN^luating 
evidence bearing oh the first set of questions outlined above. More specifi- 
cally, the study was designed primarily to assess: 

o the level and pattern of GBE/FYA correlations in generr^l sanples of 
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fbreinn ESL students in selected graduate fields^ 

o the pDjsibilily of systematic differences in_ the level and pattern of 
(3E(E/EYR correlations for subgra:ps of foreign students, especially 
subgroi$is differing in English language. backgrourxJ as reflected by 
rational-linguistic origin, and by level of perforrnance on various 
Engli^proficiency-relat^ variables, ihclixiihg total score m 

the Itest of Enq^ii^ as a Foreign Language or TOEFL {ETS, 1983 J, and 

o \*ietter improved predictiai of for forei^ ESL students rai^t be 
e^cted by gcHsidering information regarding national origin and 
scores on the TOEFL in conjunction with GRE scores, 

_ Ife stud^ was not designed to pHress guesticsis regarding the cccparative 
performance of various sdbgroi^ of foreign exaitiinees. However, exploratory 
analyses were undertaken that permitted limited inferences in this regard. 

_ _,^g stucfy vas__ (Xffriuct^ ty JSucational Testing Service (ETS) under the 
acu^ices of the Graduate Record EKaMnatiohs Board. in March 1984, 100 
graduate sdKX>is that usually re^^ the largest nunfcer of CSE scx)re_ reports 
frcin non-U.S. citizens were invited to coqperate in a stix^ with the foregoing 
objectives by providing data for sanpies of non-^.S- students, (a) regardless 
of U.S. visa status>_A^ (bl were first-tine, fuii-tine^tudents during the 
academic years 1982-83 and 1983^4^. respectively, (c) conpleted tiie academic 
year in which they initially enrolled, and (d) earned a first-year a^^rage 
grade, 

Jhe graduate fields (depar5tiOTts)^targeted for stuc^ were primarily quan^ 
titative fields khdvgi to be most _pc^3u±ar among international graduate stu^ 
dentsi engineering-Hdiendcal civile electrical, industrial, and nechanical; 
nBt±enBtics,_cheM ptysics, ccnpiter science, statistics, and ecoKxidcs. 
Several fields_that involve verbal (less heavily qucunti tat ive) stfoject 

matter were also targeted: educati^ and political science; agriculture, bi- 
ology, biochemistry, and microbiology. 

Over 100 de^rtnents provided name, sex, and date of birth identification 
for the designated entering cohorts of forei^^ students. This identificatiwi 
\^s lased to lc5rate recdrds_ of the students in the ORE ccnputerized history 
f il^i^ecords cmtaining a«E Ger^ral O^st scores and the corresponding test 
administration date(s) airf other rele\mnt infontation (if provided by indi- 
viduals \^n th^ registered to take the GR2j. 

Based_OTl the file-ihatdiing procedures, data collectiai rosters were pre- 

gred ty ETS and sent to the departments. _ Departments v;ere a^ed (a) to 
s^iy a first-year avera^ grade and, if a^^ilable, TCflSFL total score , (brto 
ictehtify native Btiglish^speakers, and (c)__ to provide information regarding 
country^of citir ndiip ancl/or U^S^ vs. non-U.S. undergraduate origin _{when the 
roster indicated that this information was not available in the GRE file for a 
student) . 

Basic requirements for inclusion of a departmental data-set in the study 

were that the department have a minimum of five foreign ESL students with: 
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c verbal, guantitative^ ard analytical ability scores f ran a restructured 
GF® General Test that vbs administered after Sep;:eiTt)er 1981 , 

6 a first-year average gfrade, and 

o data on country of citizenship. 



Distribution of Stucients by Sdibbl wd Department 

A total of 97 departments from 23 graduate schools net these basic re^ 
quireitents. Ihe departments (fields) repr'ssented and their grouping by 
academic area., were as follows: 

1. Engineering (chemical, civil, electrical^ industrial, irechanieal) 

2. Jfativ^cierce Japplix^ nath, statistics, chemistry^ E>hy3ics, 
ecjtixiter science) 

3. Economics 

4. Quantitative total (engineering + maOy'science + economics) 

5. Bioscience (microbiology, agriculture, biochemistry, bioiog/) 

6. Social science (education^ political science) 

TcSle 1 shows the distribution of ESL students school ard gradijate 
department. The 23 schcxjls (identified only by a two-digit stug^ code) ranged 
from the top ID percent through the bottcnn IG percent among the 100 graduate 
schools thait tyjpically receive the largest number of GRE score reports from 
non-U. S. citizens. 

o ihere \^re 86 department-level ESL sanples f ran primarily qpjarititative 
fields, with a total of 1,213 foreign students: 40 engineering sanples 
with a total of 702 sttadehts, 36 matfieratics and ^^ical science sanples 
(373 students), arid 10 economics sanples (138) sttdents. 

o teta were available for only 6 biological science saoiples (55 students) 
and 5 social science sanples (4 educati sanples with a total of 76 
students, and 1 political science sanple with 9 students). 

Icible 1 shows that most of the departmeht-ievei sairpies were ^ite atall. 
The actual distribution of Ns for the 97 £oreign-ESt sanples, shown in l^Dle 
2, points tp the positively skewed nature of the sanple-size dictributiOT. 

A total of 32 sanples inclvided between 5 and 9 ESL students, 36 sanples 
included between 10 and 14 students, 13 included between 15 arid 19 stie 
dents, and 16 included 20 or more students. The median N v^s 12. 

_ Data were also available for a total of 42 non-U^S. ai^isit>-native-lan- 
gmge students f ran mc:jdr English-speaking countries (31 fran tlie quantitative 
fields^ one from a bioscience field, arid 10 f ran the social science fields) . 
ihese data were enplg^ in th^ primarily to point tp differences 

between foreign Et^ students and foreign ESL students in patterns of average 
perfonnance on the GRE General Test. 
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Table 1 

DlBtrlbuttoh of Foreign ESL (English Second Language) StudenCs by School and DeparCnenC 
: _ : Depai Cmehc code 





64 


65 


Engine 


?Tlng 








Math/ 


Phystcrl Set : _ 




66 


67 


68 


Tot 


54 


59 


62 


72 


76 


78 


02 


17 


32 




12 




94 




9 






6 




02 


9 


30 


33 


12 


7 


CI 




1 1 


11 




13 


12 


to 


14 




31 






45 














13 






14 


9 


14 


37 








a 


8 




14 


6 




31 




20 


57 




15 








9 


19 




IG 








10 














24 


5 


42 


19 


i3 


24 


103 




12 


10 


15 




21 


28 












0 


5 


7 


26 








30 


13 


13 


12 




10 


48 










5 


1 1 


32 












0 














33 




1 1 


36 




17 


64 






13 




8 


16 


34 






52 






52 






5 


5 






38 




19 




25 


13 








10 


11 




12 


41 






15 












5 




1 1 


5 


49 




5 


13 






18 












7 


60 












. 0 












13 


65 


5 








10 


15 






6 








67 












0 






9 








73 


u 










29 














82 












0 












7 


87 












0 














91 












0 














92 












b 






16 








Total 


80 


162 


256 


89 lis 


702 


5 


54 


lii 


39 


51 


113 


Dep ts 


8 


8 


10 


6 


a 


40 


1 


5 


10 


4 


6 


lb 





Ecdn 






Blosc lence 






Educ 


P.S. 






Tot 


84 


Quah 


07 


31 


34 


35 


Bio 


85 


92 


Soc 


to til 






tot 
















8ci 




13 


10 


119 










-0 


26 




26 


102 


47 


15 


153 




7 


8 




15 


17 


9 


26 


194 


b 




45 










0 






0 


45 


16 


12 


65 










C 






0 


65 


"A 


6 


87 










0 






•j 


87 


id 




lb 










0 






0 


10 


58 


U 


172 


6 








6 


21 




21 


199 


38 




38 










0 






0 


38 


16 


11 


75 










0 






0 


75 


-0 


48 


48 










b 






0 


48 


37 




lOI 










b 


12 




12 


113 


10 


5 


67 










-0 






0 


67 


33 




90 




16 






16 






0 


106 


21 


12 


48 










0 






0 


48 


7 




25 








7 


7 






0 


32 


13 




13 










0 






0 


a3 


6 




21 










0 






0 


21 


9 




9 










c 






0 


9 


0 




29 










b 






d 


29 


7 




7 










b 






b 


7 


0 


a 


8 










b 






b 


8 


0 




0 






11 




1 1 






0 


11 


0 




16 










0 






b 


16 


373 


13a 1213 


6 


2 3 


19 


7 


55 


76 


9 


85 


1353 


36 


10 


86 


1 


2 


2 


1 


6 


4 


1 


3 


97 



tfo^S- QuantC Itatlve) total 1» bud of Ns for Engineering, Math & Physical Science, and Economics. 

Depar&mefv^^nd code s: Englneering--64_ Chemical, 45 Civil, 66 Electrical, 67 Industrial, 68 Hechanlcai ; 54 Applied Math. 
59 Statistics, 62 Chemistry, 72 Mathematics, 76 Physics^ 78 Computer Science; 84 Economics; 07 Microbiology, 31 Agricul- 
ture, 34 Blodhemlstry, 35 Biology; 85 Education, 92 Political Science. Agricui 
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Table 2 

Distribution of 97 Study Departments by Siise of ESL Sample 

5 2 (1) 

f 8 (1) 

^- 2 ( i) 

3* 6 (1 

3 01123 ( 55 

2* 555 ( ^ 

2 D114 (4) 

1* 55555 55777 899 (13) 

1 00000 01111 11111 12222 22222 33333 33344 4 (36) 

0* 55555 55555 66666 77777 78888 89999 99 (32) 

Note. Sattpie sizes are specified by coinbining leading digits 
with successive d-igits in the respective rows. For exaitfile, 
52, 48, 42, 36, 30, 31, 31, 32, 33, and so on. JHdn^JO^ 12. 
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?0 Yi^_?f the liitdtirf and social science saitples 

avail^ie, arxi their tj^dcally snail size, the stuc^ focussed primarily on 

data for ESL students in the 86 engineering, rnath-science, and econcmics 
departments. 



I^tional Origin and ar^ish-Lahguage Background 
of Students in the San|>le 

-- Sie san^e vas extcemely_ diverse with respect to national origin ♦ Over 
95 of 140 countries ( territories > protectorates, or other geopolitical enti- 
ties) repLresented in the examinee pofHilatioh >^ re represented in the studfy 
saitple. However, nbre than 90 percent of the 1,353 foreign ESL sttKlehts. were 
accounted for by 39 countries that were r^resented by at least five students. 
I^ie 3 lists tte 39 countries in order of total representation in the stix^ 
sanple, and shews the distribution of student-nationals by academic areas. 

o The largest contingents of students were from Asian cociitries. More than 
two^thirds of the students (67.8 percent) ware f rem Asian coiiitries, 10.9 
^rcent were from Eurc^, 8.6 percent from the Americas _{excl\xiing Cana- 
da), 7.4 percent from the Mideast, and 4.9 percent from Africa. 

English-Language Backgrcnjod-andJl^tional brfgtn 

Itg last column of_ the_table shcv^ tlie TOEFL total mean reported ty ETS 
(1983, rable 10) for all a.s.^^lxjurd TOEFL examinees frdn each country, tested 
during_1980-82, without re^ to educational level, designated as TCEFL-LEVEL 
to help reinforce the fact that 4b€^ are-430t the TCCTIi means of students in 
the sanple. 

o The national means vTOBFIi-LEVEIj values) showi in Table 3 indicate ^ical 
levels of Engli_sh_ proficiency^ as measured hy the IDEFL, for contingents 
??^?pspectiye U.S. students from the respective countries. They may be 
t±ou^t of as reflecting, in part, backgroursd dif ferences_associated with 
national-lingu^ the usual patterns of E^iglish language 

adguistion and usage (for exanple, type, auratiai, intensity, ar^ quality 
of ej^rience in the use of English as a second langu£4ge), and (b) degree 
of overlap between native language and English. _U.S.-b(Xff)d_sttadents fron 
India, Singapore^ or the Philippines, for exanple, typically have had a 
"richer" English language teckgrcnjin^ including irbre experience in losing 
En^ish in both general and academic settings than, say, students froh 
Taiwan, Japan, Thailand, or the Mideast, v^ose native languages and Ei>- 
glish, moreover, have relatively few common elements. The degree of over- 
lap betv^n_ native language and English varies markedly and it be seen 
tMt TOEFL-^LEVEL values also, tend to be hi^er for examinees from western 
European countries than for Asian or Mideastem examinees. 

o Backgroottrf differences ot^^ than those involving^ ^E^ usage 
are also partially reflected by differences in TOEFL neans. In a stuc^ of 
TOEFL examinees tested during 1977-79 (WilsOTi, 1982aJ, moderate correla- 
tions (approximately .5) were found between TC^li means arx3 publidied 
indicators of national developnnent such as literacy rate, hi^er education 



25 



Table 3 



Distribution of Students by Country of Citizenship and Academic Area 
for j>S^ Countries Represented by Five or fbre Sttrfents 



Country 


E^gin 


M&PS 


Eccai 


Quant 


Biosci 


Soc Sci 


All 


10EFL 










total 






fields 


LEVEL* 


Taiwan 


188 


94 


12 


294 


10 


16 


320 


(493) 


India 


1Q8 


63 


5 


176 


4 


1 


181 


(555) 


Korea 


68 


52 


26 


145 


7 


12 


165 


(504) 


Iran 


50 


10 


1 


61 


2 


1 


64 


(484) 


Japan 


26 


7 


7 


40 


2 


2 


44 


(487) 


KtepChina 


17 


22 


2 


4i 


2 


1 


44 


(473) 


Greece 


28 


8 


4 


4b 


2 


1 


43 


(502) 


Hong Kong 


19 


9 


3 


3i 


0 


1 


32 


(508) 


•Thailand 


17 


2 


1 


20 


3 


9 


32 


(473) 


Malaysia 


12 


4 


5 


21 


1 


5 


27 


(534) 


Pakistan 


13 


6 


2 


21 


2 


Q 


23 


(518) 


Mexico 


7 


3 


5 


15 


2 


5 


22 


(514) 


Qiile 


3 


5 


8 


16 


3 


0 


19 


(5205 


Turkey 


12 


1 


4 


i7 


i 


0 


18 


(500/ 


W Germany 


3 


ID 


4 


i? 


0 


0 


17 


(576) 


E^t 


7 


3 


3 


13 


2 


0 


15 


(485) 


Colottbia 


5 


4 


4 


13 


Q 


1 


14 


(508) 


Denmark 


11 


2 


0 


13 


0 


0 


13 


(580) 


Spain 


4 


b 


9 


is 


b 


0 


13 


(543) 


Brazil 


5 


4 


d 


9 


i 


3 


13 


(513) 


Venezuela 


5 


4 


0 


9 


0 


3 


12 


(479) 


Lebanon 


11 


1 


0 


12 


0 


0 


12 


(487) 


Peru 


3 


3 


2 


8 


1 


i 


10 


(513) 


Indonesia 


2 


1 


6 


9 


Q 


1 


ID 


(479) 


Israel 


6 


2 


0 


8 


0 


1 


9 


(528) 


Nigeria 


6 


1 


0 


7 


i 


1 


9 


(509) 


Singe^re 


3 


1 


1 


5 


b 


4 


9 


(563) 


tmlippines 1 


4 


2 


7 


e 


1 


8 


(547) 


ALgeria 


5 


3 


D 


8 


0 


0 


8 


(511) 


Tftigoslavia 


3 


5 


0 


8 


0 


0 


8 


(530) 


Jor^n 


4 


3 


0 


7 


0 


1 


8 


(458) 


Cyprus 


2 


3 


1 


6 


0 


0 


6 


(482) 


Ivory Coast 0 


0 


4 


4 


1 


1 


6 


(498) 


Argentina 


2 


2 


2 


6 


d 


b 


6 


(543) 


Ifepal 


5 


0 


0 


5 


0 


1 


6 


(523) 


Italy 


4 


0 


0 


4 


D 


1 


5 


(552) 


Ttenzania 


i 


1 


0 


2 


1 


2 


5 


(542) 


Bangladesh 


2 


1 


2 


5 


0 


0 


5 


(483) 


Vietnam 


3 


2 


0 


5 


0 


0 


5 


(497) 


Subtotal : 


671 


346 


125 


1142 


46 


76 


1266 




4 of Total 


95.6 


92.8 


88.7 


94.1 


87.3 


89.4 


93.6 




Ttotal 


702 


373 


141 


1213 


55 


85 


1353 





*TOETIj-LEm tt^ TOEFL Tbtal mean for all IDEFIr-takers f ran the country 
during tte period 1980-^2, as reported by ETS (1S83, Table 10) ^ not Qie i^an 
fbrjstaden t-natiom ls— in the present study. The grand mean for all TOEFL 
examinees during 1980-82 was 503, s.D. « 66. 
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ehrbllneht rate, per ce^ita ej^hditures for eddcatiOTi, eiid so on, in 

analyses involving iteans for sore 100 different countries. Students front 
M^T^r TCBFIr-LEVEL countries as ccrapared to those from lower. T^Fb-LEVa.. 
ccxintries niay tend to ehjcy scire educaticoTal advantages as well as advan- 
tages in the acguisitidn of general ESL proficiency. 

Mean T^Tj-I£\^ differences appear to be quite stable over time. In the 
stuc^ cited al>ove, a correlation of .94 vas found between neans of 129 nation- 
al contingents of U.S. -bound raEFL-takers in twD different testing years. 



A claussificatidn of oxintries of citizenship that takes into account both 
geograpWc Icjcation (wrld regi^) ard characteristic diffe English 
language badcgrocmd is provi^d in^ibie 4^ U.S.-boirri stu^ (^o take U.S. 
admission-related examinations) from Category I countries (Asia I, Earope I, 
Africa America I), as conyared to their Category II cxnjnterparts , ^^ical- 
ly^ (a) have had more extensive experience in usin^ English as a second lan- 
guage^ a!x(^^ (b) earn hi^ier average_scpres qh Uie TOEEl.^ arid on other 
EngHsh-language verbal nBasures suc±i as GI^^V^^ GMfiT Verbal ^ or (c) 
earn verbal scores that are relatively more consistent with e:^ctation based 
on their quantitatiA^ scores (see, jSIS, 1983; Etowers^ i98(); WilSOT 1982a, 
19B2b, 1984a, _1984b^ 1985, 1986b). No withih-regiai subgrocping v;as jtdged to 
be feasible for the Mideastem countries, v*iich tend to have Category II 
(Characteristics. 

The last column of the t^le shc5ws for each regional clas^^^^ 

average of the 1QEFL-t£?^ values for Uie respective rreirter^c^ Xshown 
in Tdtle 3) wei^ted according to the nuntoer of students represented in the 
present sanple, including students from "other", countries. To reiterate, 
these TCEFI/^LEVEL values are riot the TOEFL means of stixients in the sanple. 

As a working j)rc^siy.cri, ^^^1^^^ the backgrdunds of U.S.- 

bound stirients f ran Catego^^ I countries as cotrpared to Category II o^untr i es, 
typically, were more conducive to development of general ESL communicative 
coipetence. 
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T^le 4 

Distribution of Foreign ESL Students by Country of Citizenship 
within "Regional" Classifications Based on Geographic 
and Diglish~Bad(grdund-Related vnairiables 

Academic area 



RegiorV 


Enqin 


M&FS 


Eoon 


Quant 


Biosci 


Soc Sci 


Ttotal 


TOEFL 


douritry* 








total 








LEVEL* 


Xftia II 


(374) 


(203) 




(66) 


(643) 




(29) 


. ___ 
(48) 




(720) 


496 


l^iv«n 


168 


94 


12 


294 


10 


16 


320 




Korea 


158 


52 


26 


146 


7 


12 


165 




Japan 




7 


7 


40 


2 


2 


44 




BtspCliiha 


n 


22 


2 


41 


2 


1 


44 




Hoog KOdg 


19 


9 


3 


31 


0 


1 


32 




Oiailand 


17 


2 


1 


20 


3 


9 


32 




Malaysia 


12 


4 


5 


21 


1 


5 


27 




Pakistan 


13 


6 


2 


21 


2 


b 


23 




Indonesia 


2 


I 


6 


9 


0 


1 


Id 




Mepal 


5 


0 


0 


5 


0 


I 


6 




Bangladesh 


2 


I 


2 


5 


Q 


0 


5 




Vietnam 


3 


2 


0 


5 


0 


c 


5 




Other 


2 


3 


b 


5 


2 


0 


13 




Xfiia I 


(112) 


(68) 


(B) 


[188) 


(4) 


(6) 


(196) 


556 


India . _ 


108 


63 


5 


176 


4 


1 


IBl 




Singapore 


3 


1 


1 


5 


0 


4 


9 




Philippines 1 


4 


2 


7 


0 


1 


6 




Other 


0 


d 


0 


0 


d 


d 


d 




Kidaast 


(76) 


(20) 


(2) 


(98) 


(2) 


(4) 


(104) 


483 


Iran 


5b 


10 


1 


61 


2 


1 


64 




Lebanon 


11 


1 


d 


12 


b 


b 


12 




Israel 


6 


2 


0 


8 


6 


1 


9 




Jordan 


4 


3 


0 


7 


0 


1 


-S 




Other 


5 


4 


1 


10 


0 


1 


11 




taerica II (35) 


(27) 


(24) 


(86) 


(7) 


(16) 


(109) 


512 


Mexico 


7 


3 


5 


15 


2 


5 


22 




Oiile... 


3 


5 


8 


16 


3 


0 


19 




Cploqbia 


5 


4 


4 


13 


0 


1 


14 




Brazil 


5 


4 


0 


9 


1 


3 


13 




V^zuela 


5 


4 


b 


9 


0 


3 


12 




Peni 


3 


3 


2 


8 


1 


1 


lb 




^gehtina 


2 


2 


2 


6 


d 


d 


6 




Other 


5 


2 


3 


10 


0 


3 


13 





TBble 4, page 2 of 2 pages 



Academic area 



RegicT/ 


Digin 


M&PS 


Econ 


Quant 


Biosci 


Soc Sci 


Total 


TOEFL 


Country 








total 








LEVEL* 


Merica I 


(0) 


(3) 


(3) 


(6) 


(1) 


(0) 


(7) 


555 


Europe II 


(49) 


(2b) 


(9) 


(78) 


(3) 


(2) 


(83) 


607 


Greece 


28 


8 


4 


40 


2 


I 


43 




IQrkey 


12 


1 


4 


17 


1 


0 


18 




Yugoslavia 


3 


5 


0 


8 


0 


0 


a 




Q^rus 


2 


3 


1 


6 


b 


0 


6 




Other 


4 


3 


b 


7 


d 


1 


8 




EUFope I 


(29) 


(18) 


(15) 


(62) 


(0) 


(2) 


(64) 


561 


W Gerneny 


3 


10 


4 


17 


0 


0 


17 




Penoark 


11 


2 


b 


13 


b 


b 


13 




Spain 


4 


d 


9 


13 


d 


d 


13 




Italy 


4 


0 


0 


-4 


0 


I 


-5 




oeher 


7 


6 


2 


15 


0 


1 


16 




Africa II 


(16) 


(9) 


(8) 


(33) 


(6) 


(3) 


(42) 




Egypt 


7 


3 


3 


13 


2 


0 


15 




Algeria 


5 


3 


0 


6 


0 


0 


8 




Ivory Coast 0 


0 


<i 


4 


1 


1 


6 




Other 


4 


3 


1 


8 


3 


2 


13 




Africa I 


(lb) 


(5) 


(2) 


(17) 


(3) 


(4) 


(24) 


539 


Nigeria 


6 


1 


0 


7 


1 


1 


9 




Tanzania 


1 


1 


0 


2 


1 


2 


5 




Other 


3 


3 


2 


8 


1 


1 


10 






702 


373 


141 


1213 


55 


85 


1353 


510 



Note, dassificaticn df countries vdthin seVbraI_of _the_ world. regions (Asia I 
versu&_Asia _II^_Burope Iiversus EUrope_ n, jurf so onj takes inb? account 
<Uf ferer«es_ in QigUsh-language tockgr^^ _natipf^-li^?9'^sUc 
origin. Contingents of U.S. -bound students from Category I countries as oaBk- 
pared to those from Cate^ry^I^ countries are assuned to har>e backgrcuids that 
aire »re boncKicive to the aoquistidn of QL proficiency. -Consider ^ for .exaobr 
pie, ^ical pattemt ot ESL acgulsition and usage in Aaerica II (e_.g., Me^^ 
and_ South Aroerica) versus America I, a classification that includes Guyana, 
Haiti, Honduras, Jamaica, Trinidad and T(±iago (none of which was represented 
by five or mare rationals in the study sample), bcwhtries with istrong Qiglisfi- 
speaiking traditions. 

• _Itse_ regional TDEFL-I^/EL vali^s shown in the last oplmn are averages of the 
nenber-country TOEFL-l£VEL values wei^ted according to the mnfcer of students 
fron those countries (see Table 3 for country values and definitional notes), 
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Secticsn II: Description of Stiic^ Variables and 
Saitple Performance on the variables 



_ WE iSeheral l^st verbal, quantitative ^ ahd_ analytical SDility scores and 
a first-year average_grade v^ere available for all students. Data _on_ under- 
graduate origin (U.S. versus other) ^ age^ and sex v?ere available for most 

students. Several variables thou^t of as reflecting different aspects of 

"acquired proficiency" were also erapic^ed: 

b total score on the Ttest of English as a Foreign Language (ICSfIj) 

d the discr^>ancy between ctosfrved GRE verbal scores and the scores that 
J^^^^cted for eMminees _vath given quantitative scores 

( a re la t i v e^ veri ja l -perfonnance-index^r RVPI ) 

o a similarly derived discrepancy index for the analyticai score relative to 
the__quantitative score ( a relative analytical performance index,- or 
RANPI ), 

o self-reported EUgli^ language commicati^ cortnuni 
in Bngli^ (BCE) than in any other language versus the opposite stattis). 

Jfore detailed information regarding these English-prof iciency-reiated 
variables and their relets) in the study, findings regarding the performance 
of tile sanple^OT these and other stucfy variables^ and the intercor relations of 
study variables in the total saitple sanple are provided later in this section. 

_ Scaled-scores (200 - 800) for the (3^ verbal, qu^ titative, and analyti- 
cal measures were available from testing after September I98i. ftie predictive 
pirqperties of the traditional verbal aid quantitative measures are v^ll khcTm. 
tess is Jmgwn regardU.ng patterns of predictive validity in different acadCTiic 
areas for tte analytical abili^^ re introduced in October 1981 . 

Positive correlations are expected a priori for GRE scores and academic cri- 
teria. Jfegative validity coefficients for the are theoretically anomalous 
and, if found, usually may be explained in terms of sanpling error or 
selection effects. 

Sie Fffi criterion was reported on the same numerical, scale by all dej^rt- 

ments, nanely, A = 4^ 3, C = 2, D = 1, and F = 0. As is well known, the 
FYPi metric is gradin^-context i^cific— that is, the "^Jewl" of academic per- 
formance associated with a given FYft cannot be be assuned to be ccnparable 
across different de^rtments. _ in assessing O^/FCV validity, therefore, 
attention is focussed primarily on analysis of within-department relation- 
ships. 

_ At the ^me time, grades generally have the same relative significance 
across ail grading ccntexts--for exanple, in deparl^nentally^ heterogeneous 

sanples, students with mean of 3.8 nay te assijmed to be faring relatively 

better acadeanically, cx\ the a^rage, within their respective dejKirtments tten 
students with mean FTf!A averaging 3.0. Ihus, even vAien consictered without 
regard to department of enrollment (grading context), the FYA conveys useful 
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infotrnaticBi regarding tJie academic progress arri accortplishment of students. 
It is assxjmed that within--department grading standards were caiparable for ail 
students regardless of citizenship status. 



Vlarisides Related to I3ngliidi Proficiency 

TOEFL Total Score 



The TOEFL total score (reported dri a scale with an effective range be- 
tween 213 and 677) reflects _^rfarnBnce^ three separate measures: English 
vocat^lary and ^reading catpr^nsiop (with items that are more general in na- 
ture and considerably less difficult than the vocabulary arri reading 
herisidn items in the gre verbal test), knowledge of rules governing aiglish 
language structure and vnri tten^ gjpres^^ and a measure of English language 
listening ccitt>rehension (ETS, 1983), In the present stxxiy, TOEFL total score 
was treated both as a potential predictor of F!C\ and as a basis for classify- 
ing students according to general levels of aigiish proficiency. 

TOEFL total score _is_mcx3erately hi^y correlated with verbal score 
in general samples of TOEFTyUE^ testr takers. For a general saitple of _ 3,808 
TOpVGE^.e during 1977-79 (Wilson^ 19B2b), the correlation 

between these tro scores approximately this amount of overlaps 

the correlations of the respective iteasures with academic criteria mi^t be 
expected to be approximately equal. Ihere is evidence suggesting that this is 
a reasonable working hypothesis (see Sharon [1972] for evidence of jjarallel 
patterns of criterionr-related validity for GRE-V and TOEFL; see also, Wilson 
[1985] for evidence of j^rallel levels of validity for scores on the verbal 
section of the_ Graduate Management Admission TCst [GMAT] and TOEFL^ respec- 
tively, in sairpies of foreign ESL MBA students). 

TOEFL total scores were stjplied for only about 60 percent of all foreign 

^^tudents (N = 818|. Oily 68 of the 97 department-level sanples sillied 
TOEFL scores for at least five students. Information was not available on 
departnental TOEFL re^ bases for exemption, and so on. Several de^ 

partrents v^th relati\^ly^ nuitters of stxrf^ indicated that because of 
clerical prc±)lems they were not providing TOEIl. scores. The uneven availabili- 
ty of TOEFL scores across departnents results in sone interpretive complic- 
ations in analyses involving TOEFL scores. 

10Ej?'L score estimated f rom GRFVerbal _scbre CTOEFL-EST) . To provide an 

estimate of TOpii jie rfonrence (TOEFE/-EST) for students foF \*iom TOML total 
scores were not available, a regression eguation for predicting TOEFL total 
score (T') frean GRE verbal (Vj score was derived ^sing-data for the 1977-79 
GRE/pEFL sciitple cited above (GRE-V, mean = 360, S.D. =108; TOEFL Itotal mean 
= 559, S.D. = 53; r = .70): T' = TaSFi>EST (Pg^>) = .406 (V) + 413. 



TOEFL/VERBftL . For e^ldratbry purposes, a variable called TOEFVVERBftL 
was created by inputing TOEFL-EST scores for individuals without TOEFL Ttotal 
scores. 
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(3^ VexfaaL^arfQnt«nce Relative to Qngntitgtivg Perfortrgnce 

Ihe cJiscrepancy betwEMgn eteserved GE^V score, V, arri the predicted GRB-V 
scbre^ VS that vbuld be predicted from GRE-Q_ score, tising a regressicii eqaa- 
ticsi based (OTi data for U.S. examinees ( called a Itelative_Verbal Perfonnarice 
or^BSgX) , may be thou^t of as indexiig "degree of Qiglish proficiency 
deficit" in the vertei perfonnahce of foreign GRE examinees (Wilson, 1984a, 
1986b). 

For natibhal ccntingehts of foreign ESL_ exaitdhees, ite RVPi values (a) 
are i^tCTBtically negative, (b) are typically relatively large in ateblute 
value, ard (c) terd to vary with ESiglis^ For cqhtiiKjerits 

of foreign ElJLjl^glish^ Gra: exanunees^ on the othe hartd, 

neah R\^I vaites tend to vary around zero, as would be the case for saitples of 
U.S. examihees. 

Ihe predicted verbal score used in .calculating the RVPI was cottputed 
losing a regression e^oatidn based on data__fd^^ U.S. mathematics physical 
science examinees tested^rijig 1981-82 (GRE-V, mean = 520, S.D. = 109; GREH3 
* 645, S.D. 104; estimated r = .50), described in detail elsewhere (Wilsai, 
1984a): 

Kidictai veitel = V = -52 (Q) ± 185 ^ and 
RVPI ^ V - V , \ihere V === observed verbal score. 

In the^resent stut^, the RVPI was treated as a potential mcxierator of GBE/TfPi 
relationdiips . * 



GRE i^rialytical Performance Relative to Quantitative Performance 

Procedures analogous to Uiose used deriving the RVPI ^ to 

derive an index of tiie discrepancy beta^n oteerved GRE analytical score. A, 
and tile predicted analytical score, A[ (the score that would be predicted for 
a V^S^ exconihee with a given, quantitative score). Ihis discrepancy, infex. was 
called the Relative Analytical Performance Index^ or RANPI. The analytical a- 
bilil^ measure calls for relatively extensive verbal processing, ulbeit of a 



* in a stucty involving GrM* verbal and quantitative scores for MEA stirfents 
from 59 sdx)61s. (Wilson, 1985), a conparabiy derived R^i measure (reflecting 
QlAT--V_score._relative to GKAT~V score predicted from G^h2 lasihg ait . equation 
for U.S. GMKT exaMnees) was |^ as a potential mbderator variable . VJhen 

ESL MBR students were^ accbrding to roughly the tbp^ midctte^ ard 

tottOT thirds on the RWPI_index^ the GMOT/FYA cx)rrelaticxis were fourd to be 
highest for examinees in the t^ third OT the^^C^^ (assumed to have the 
least Bng^i^ proficiency deficit), lowest for those in the bottom third 
(assumed to have tte greatest Bn^i^ proficiency deficit, and in between for 
stuttents in the jnicHle third (w.6i iredium Bagli^ proficiency deficit). This 
finding indicated that the OAT RVPI "moderated" GMAT/FXA relationships in 
samples of foreign ESL MBA students. 
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inpre specialized diaracter than that involved iii the GRE verbal, test. The 
Rfil^Ir j^ch tos^^n^ been used previously, ms thou^t of as possibly irtdexing 
a scmev^iat different tyje of "English proficiency deficit the foreign ESL 

population than t±iat indexed by the i^I. In the present study FANPI v^s 
treated as a potential moderator of GRE/FYA relationships. 

The equation specified below was used to obtain predicted analytical 

score (A' ) . The equation was based on data for the saitple of 1981-82 U. S . 
examinees cited above, without regard to field of sttidy: analytical mean « 
520, standard deviation = 124; quantitative mean = 521, standard deviation = 
132; estimated Q,A correlation = .65. 

JPraJicted analytical = A' = .611(g) + 202^ arid 
KANFE ^ A - A'^ ^^Fe A = observed analytical soore. 



Self-Reported ^glish Language Connpni cation Status 

ORE background questions include, "Do you ccninunicate better in English 
than in ar^ other language?" For study purposes "Yes" = SR-BCE (self^repbrted 
better cotttm 1; "Nip" and "no response" « 0^ For- 
eign exardnees v*io report BCE status typically are from nonnative-^glish 

speaking comtries witii a strong English speaking tradition, ihey ^jjpicaliy 
are not natively proficient in English but tend to be more proficient than 
their_ESL counterparts who report better coniTTuni cation in a language other 
than English, as indicated ir/ hi^er average scores C5h the TOEFL and the WE 
Verbal Ifest, fcsr exairple. However, the ESL-BCE examinees earn lower average 
vei±al scores than foreign EWL (English native language) examinees (Wilson, 
1982b). 



Other V&riables 



The TOEFL total mean reported by ETS (1983) for all 1980-82 TOEFI/^takers 
from a given comtry ^^^s ascrited to each stiident from that country in the 
present stucfy Scmpie. This variable, called TOEE^LE\^ (see 3 and 4 

and related discussion), was thou^t of as reflecting differences in aiglii^ 
language and educational background associated with hatiohal-lihguistic 
origin. 

Information regarcJing sex, age in years (as of October 1982), and under- 
graduate origin (U.S. versus other location) was available for most students. 



Perfonnance on the Sttxf^ Varisides 



T^le 5 provides sijottnary statistics (means ard staridard_deviations) for 
the variables described in t^ preceding section for foreign ESL students, by 
broad academic area. F^r perspective, st^ shown for the total 

sanple (N = 42) of foreign EIC (English native language) students. 
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Teble 5 

Suitinary Statistics for the ESL Sanple on Selected Study Variables, by 
Broad Academic Areas, with C5St|>arati\^ Data for All ENL Students* 



^L^-san p l e - ENL sanple 



Variable 


^tal 


Quant 
total 


Biosci 


Soc Sci 


Total 


FXA (Mean) 

(Standard deviation) 


3.45 
0.42 


3.49 
0.41 


3. is 

0.52 


3.44 
0.42 


3.55 
0.44 


GE(E Verbal 


382.0 
105.6 


384.4 
106.1 


375.5 
88.1 


351.5 
103.3 


546.0 
131.4 


Analytical 


485.6 
107.0 


492.1 
105.6 


450.5 
108.1 


414.5 
94.9 


591.7 
126.8 


GSE Quahtitative 


684.3 
98.7 


698.4 
81.3 


595.8 
127.3 


541.3 
148.3 


684.5 
113.4 


Relative V&rbal 
Eferfonnance Index (RVPI) 


-158.9 
106.7 


-163.8 
104.7 


-119.4 
106.3 


-114.9 
118.9 


5.0 
126.7 


Relative Ancdytical Per- 
fonnanoe Index (KANPi) 


-134.2 
92.4 


-136.2 
91.7 


-115.2 
94.2 


-117.9 
99.0 


-28.2 
106.7 


lUiFL K)tal 


566.9(a) 
44.7 


568.0(b) 
44.7 


549.7(c) 
43.0 


549. 5(d) 
40 7 


N.A. 


T&SFL ^timated 
from GRE Verbal 


568.1 
42.9 


569.1 
43.1 


565.4 
35.8 


555.7 
42.0 


634.7 
53.3 


TDEFLEVL (Cbuntry means 
ascribed to studints) 


510.2 
28.7 


510. 7 
29.0 


504.0 
20.4 


506.8 
28.2 


N.A. 


Seif-Repbrted Better Caa- 
inunicator in Bngliidi = 1 


0.16 


0.16 


0.20 


0.16 


N.A. 


Attended U^S. Undergrad- 
xjate School = 1 


0.16 


0.16 


0.22 


0.14 


0.12 


Sex (M = 0, F = 1) 


0.17 


0.13 


0.27 


0.61 


0.31 


Age (in years, as of 
Octcfcer 1982) 


25.8 
4.0 


25.4 
3.7 


27.2 
4.5 


29.8 
5.3 


26.3 
6.4 



* Means in first, row for all vai:iables> standard deviations in row_2_ ex- 
ci^t for nominally coded (1,0) variables. Ns for groups were, from left to 
ri^t, 1353, 1213; 55/_85, and 42, except for Age (total ESL N = 1286)^ 
^x (N « 1307) , and jraili lbta^^ (b) N_= 771^ (c) N = 22, and 

(d) N = 25^ NJ^. indicates not applicable for English-native-language 
(Q^) students. 

Diskette 546.84, working copy of 2, Document 2 
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First-Year Average Grade 

For tiie total sairple of foreign students, ms SAS; for 

those in qocuititative fields, t±ie jnean was 3.49^ For th e foreigp ENL stu- 
dents, mean F^ was 3,55. ^ich mean F3ft levels are oonsistent_with tl^^ 
reported ty ESS for saoiples coi{x^ed predbodnantly of U.S. citizens- Ihe mean 
of 3.18 for students in bioscience departments is based on data for only 55 
students frotn six departments. 

o Se ^ Validity Stu§ Service (VSS) at reported median first-year 
averages of 3.39 for 49 fiTysicai science departnents, 3.53 for 33 
bioscience departments, and 3^51 for 102_ social science department-level 
saitples^ respectively (Burton & Turner,, 1983) . Althou^ very few of the 
departments participating _in this study \vere included cuiot those that 
participated in Uie GRE VSS, the cdn|>arison suggests that these foreign 

ESL students , especially those in quantitative fields , probably earned 

first year grades cotparabie to those of their U.S. counterparts. 



GRE General Test Performance 

Several trends are notewortl^ (see ^^pendix A for de|»rtmeht-level data): 

o Ihe quantitative abiii^ mean for all foreign _ESL students a^ for those 
in_quantitative departments was above the eigfttietli percentile for basic 
GRE reference groups (e.g., ETS^ 1985, p. 17). For all major areas, 
including the social sciences, the basic pattern of abilities was the 
sane: hi^est on quantitative, lowest on verbal, vath analytical in 
between. 

o Foreign ESL students and forei^ students had identi caimans on the 
quantitative measure, but the verbal and analytical means of ESL 
students were much Ic^r than those of ENL students. 

o The large jieg^tivej^l and RANPI itteans (-158.9 and -134.2, respectively) 
for foreign ESL students indicate average verbal and analytical perform^ 
ance markedly lower than would be esqpected for U.S. examinees vd.th GRE 
quantitative scores averaging 684- Nbte that the vei±>al and analytical 
means for ENL stiSents. were quite consistent with expectation for U.S. 
examinees: mean RVPI = 5.0 arid mean HfiNPl = -28.2, discrepancies that may 
be accounted for by saitpling effects. 

For perspective, the medians of the distributions of nearis of verbal 
and quantitative scores for 57 physical science deparbrBnts farticipating in 
the WE VSS throu^ June 1982 were verbal 7^ 528 yd^^gnantitative ^ 687 (Burton 
and Turner, 1983, p. A-1) as ccnpared to 384 and 698 for ESL students in the 
present stucfy. Ihe median analytical mean for GRE VSS participants was 588 
(for scores on the pre-Octcter 1981 analytical test only). 
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TOEFL Perfontehce 

^yxrUt 60 percent of tJie total sanple but prcportionately fewer of tiiosc 
in bioscience and social science saiiples had.TSITj scores. the TCEFL total 
nean of 567 ir^cates students with TOEFL scores vere hi^y selected 

in terms of the aspects_of English proficieng^ measured this test— the 

average student \ms at appracimateiy the eigfrty-fourth percentile for all 
graduate-level TOEFL examinees (EfS, 1983). 

Sie T^t^ST mean^ 568^ indicates the nean__bf the_ distribution of 
estinated TOEEt sro same GRE__\^rbal nean as that of 

tiie present sanple. close agreement between the^^^^ TOEFL^EST means 

indicates that students TOthout TOSTi scores had (3^ vertel scores coro^rable 
to those with TQGFL scores. ftus suggests that^ ai the average, students 
without .ICEFL scores were rau^ily comparable to thos3 with WSFL scores in 
terms of aspects of "English proficiency" tapped by the GRE verbal measure, it 
is of inci^nt^ interest to note that the estimated TC^FL_score for the ENL 
staxtents v^s approximatelj^^G^ than the TOEFL irean attained by 

any contingent of U.S.^XTund TC^FL-takers. 

The high TOEFL mean for the foreign ESL saitple reflects in part the fact 
that foreign ESL applicants typically are screened for "English proficiency. " 
Presumably^ those admitted are jtxJged to have either (a) at least a minimally 
adequate level of proficiency in English to tegin aca^ stuc^ full-time or 
part-time and/or (b) a reasonable likelihood of being able to acquire a 
minimally adequate level given a period of intensive ESL instruction. 

HoTOver, the hi^i TOEFL mean _is also attributable in part to the fact 
that TOEFL exairiinees vAio take the GRE^ oh the average, are much ncre profici- 
ent in those aspects of English proficiency measured \y/ the TOEFL than TOEFL 
examinees generally. 

o For sone 3^868 TCEFL/^lE examinees tested during 1977-79, for exanple, the 
ICEFL total mean was 559 (Wilson, 1982b|t as compared to a ireah of 508 for 
all_graduate-level TOEFL exaininees tested during 1980-82 (ETS, 1983). ihe 
TOOTL nsean of 559 rorrespo the eightieth ^rcentile rank in the 

distributim of scores for all graduate-level TOEFL examinees tested 
during 1986-82. 

Results of surveys of institutions to determine score levels on the TOEFL 
that are associated with varicais types of admissions decisions te.g., ECS, 
1983), indicate that scores in the 550 range frequently _are judged to be 
sufficient for unconditional admission to academic programs for ESL agplicants 
judged to be academic ally qualified — that is, for beginning acad^c work 
without concatatant participation in intensive ESL instruction or other 
activities desigrBsd to inprove Engrlisdi proficiency. Ihus, it is possible that 
many if not most of_ the ESL students in the present sample may teve surpassed 
a "threshold" level of proficiency required for academic ftoictioning in an 
English^language environiterit-^ as students, in fields that enphasize 

primarily quantitative abilities, internationally emplcyed notations, special- 
ized Eliglish vocatulary, and so on. 
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Other Variables 

Ihe TQEFtr-t^EL mean for the ESL sanple va*. 510~ecldse to the grand mean 

for all U.S.-bourxJ TOEFL examinees as reported by BIS (1983). Tb reiterate^. 

TOEFL-LEVEL was derived by ascribing to eadi student in t±ie sanple from a giv- 
en country the TOEFL total mean of individuals fron that country vho took the 
TOEFL during 1980^82 ^ as reported by ETS (1983) • 

J^xait 16 percent of the ESL stirfents reported BCE status (better ccnmuni— 
catibh in English than any other language), and the same percentage reported 
attending a U.S. urxJergraduate school.* 

Some 17 percent of the students were female. Average age for all ESL 
students '^s 25.8 years; stlx3ents in scKrial sciences (primarily education) 
were considerably older (mean = 29.8 years), and those in biosciences were 
SQmev*iat older (mean =27.2 years) than those in the quantitative fields (irean 
= 25.4 years) . 



Intercdrrelatichs of Selected V&riables in the Total ES5L Sanple 

l^ie 6 shows intercorreiations of designated stuc^ variables in the 

total ESL sample; intercorreiations of GRE scores and the two jneasures derived 

fron GE^ scores (RVPI and RANPI) are shorn for the total foreign EIC sairple. 

o 'Sie correlation between GRE verbal and TOEFL _in the sanpls of ESL students 
(.71) was alitcst identical vdt^ that (.70) found in the general sample of 
TOEFL/tSOS examinees referred to earlier. 

o The analytical measure and the RM^3PI as ca^red to the verbal measure and 
the_FOTI _ had substantially lower correlations with T^FL total score, 
TOEFL^LEVEL, and self-reported BCE status. Ihis suggests that, the type of 
ESL facility measured by the verbal, test is not _ very similar to that 
measured the analytical test. RVPI and RfiNPI were not strongly 
correlated (r = .41). 

o Differences on other study variables between students with TOEFL scores 
ard those without TOEFL scores are pointed up by coefficients for a 

variable called YES^TOEFL (l.^^ stixieht had a score versus 0 = ho score 

availstole). Students wi^^ TOEFL scores, oh the average, were (a) quite 
similar to those with TOEFL scores in terms of mean score oh the verbal 
and analytical measures (r = .00 and r = .03), (b) sligjitly lower, on the 
average, with respect to R\^i and (low negative correlations), but 

(c) somewhat hi^er in guanti- tative ability (r = .12). 

o Bie strongest single obrrelate of YBS-TCK^ was location of infergraduate 
scisDol (r = -.36). Students not reporting a U.S. undergraduate school 

*Bot±i of these are underestimtes of ^ of students in the 

respective statuses since they represent the percentage of all students, in- 
clixJing some for v*icm data were not available. 
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Table 6 

Intercx)rrelations of Selected Stucty Variables in the Tbtai ESL Sample 

Tbtai correlation inatrix 



Variable 


V 


A 


Q 


RVPI 


PI 


TOfci'L YES ?n»FL SR- 
total TFL Level BCE 


A§e 




U.S, 
Sch 


GRB-V 


.50 

Tig 


.46 
.54 


.22 
.51 


.88 
.21 
-.26 


.39 
.83 
-.07 


.71 .00 .52 .26 
.48 .03 .22 .03 
.25 .12 -.01 -.01 


-.18 
-.35 
-.26 


-.07 
-.05 
-.27 


-.03 
-.04 
-.16 


RANPZ 


.90 

in 


^6 
753 


-.15 
-.01 


.41 


.42 


.60 -.06 .52 .26 
.41 -.05 .25 .04 


-.05 
-.24 


.06 
.12 


.05 
.06 


Total 
YES-TFL = 1* 
H^T— lEVEL 
St-BCE = i 












— .00* .50 .28 
— .08 -.01 
— .35 


-.20 
.02 
-.13 
-.11 


-.04 
-.06 
-.04 
-.03 


-.05 
-.36 
-.12 
.01 


Sex (« = 0, F 


= 1) 














-.01 


-.20 
-.01 



U.S. urxtergraduate sdiddl = 1 

Note. N « 1353 for coefficients abov^ diagcsnal except those involving 
(maxi imjm N » 1286 ) ^ Sex (N « 1307), U.S. undergraduate schgpljN » 1291)^ and 
TOm* Ibtal (N « 818). Entries below the diagonal are coefficients iiwoiving 
GE?E scores, or variables derived .using C3RE scores, for the total sanple of 
EM* (English-native^langua^) students = 42). 

* YE^TFL = YES-ICEFL = TOEFL Total score available = 1; not available = 0. 
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\^re nibre likely to have TOEFL scores and vice versa. This is consistent 
with the fact that a record of successful perfcnnarice in a U.S. sciiool is 
frequent- ly accepted as evidence of adequate KL_ proficiency— applicants 
with sudi a record may be exenpted from taking TOEFL (ETS, 1983). 

o It is noteworthy that ESL students v*i6 reported a U.S. iSidergraduate 
school tended to have lower GBE scores, especially GRE quantitative scores 
(r » -.16) thari their counterparts v*ib did not do so. 

o eorreiatidns In the .5 range for GRE verbal, RVPI, and TOEFL total, re- 
spectively, with TC^ ^L^^EL irrficate that classification of students with 
respect to level of performance on these measures of verbal skills would 
result in_ substantial incidental sorting in terms of background variables 
that are linked to country of citizenship through the TOEFL-LEVEL score. 

o Thejattern of coefficients for self-reporte^^ status with th verbal 
test measures was like that for TOEFL-LEVEL, but relationships were 
conside rably weake r . 
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Section III: Stucfy Metlicds and Procedures 

Data were available for 97 small^inples of ESL sttsdents predbctdnaritly 
frdm^ q\iantitative fields: engineering, nathonatics, chemistry, physics^ 
statistics^ con|xiter science, and eecHicinics. Ctonplete S^^/Fffi data v;Bre also 
available for sanples frcam f ive ^bioscience departments, and six social 

scienre departnents (five departments and one political science 

department). Mso available on a con|)rete-data basis Were TOETL-LEVEL scores 
arfl scores. Cffi two nattdnaliy coded (1,0) background variables: U.S. undergrade- 
yate school versy? other status, and self-reported better ccnttunication in 
English (SR^^BCE) versus other status- TOEFL scores were available for at 
least five stu- dents in only 68 departments, 

Ihe present stu^ vas cai«med primarily vdth ass^jsing the typical 

levels of \athin-^partrKnt relaticpships for foreign ESL students 

^nerally and_ in x^rious sdbgrccjjs. Estimates of ORE yalidi^ coefficients 
based on single small samples suc3i as those avaiietoie for study wjuld not be 
reliable. BDwever^ by EX)bling infonnation from all the snail sanples, reliable 
estiitgtes of the ta^ical witMrvHdepartn^nt correlation between GRE scores, 
Fffi, and other vari ?^l?^_P?^_be ctotained by analyzing inter relatidnshij^ sonong 
departmentaiiy standanJized predU.ctor and criterion scores in pooled sanples 
of students from "sindiar" departments— that is, by analyzing ^» within- 
departrrent data matrices. Cbefficiehts in these matrices siJnmarize basic 
trends in the distributions of department-level CSe/FSV coefficients. 



It is conveniedit to staf^ the jpredictor variables as v^ll as_ the 

criterion variable ^itaaa=attentlon is focussed primarily on assessing trends in 
vdthin-departmerA predictor/crite^<m^correlaU^TS= in the preient study) 
rather thah^cai the developtnent of operation al p redictive- equations for Aise in 
particular^departainents . In the present study, data for U.sT students v^re not 
available for analysis. 



General HethodDlogical l^tidnale 

Given conSon (3R^/Fm (predictbr/critericn) data sets for a relati\^ly 
large number of small sanples of individuals in "similar" graduate programs 
being offered ly departments in different graduate schools, it is possible to 
draw meaningfui inf^ regarding ganerll levels and patterns of (3^S/F^ 

(predictor/criterion) correlation and the relative v^ei^tihg of predictors by 
pcxDling data from ail ^e "similar'* settings^ Tte estimates derived from the 
pooled data nay be tlrau^^ of as approximating population estimates. 

Crje useful pooling procedure involves standardization of the predictor 
aaid criterion ^^riables of interest vdthin. each. department-level sanple prior 
to pooUng (see, for_e^^ Wilson^ 1979, 1982c, 1985^ 19B6a, igSBb). in 
this ^proadi, original or ra^^ on the respective ^^riables are subject- 

ed to a z-scate transfornetiOTi— raw sco ej^ressed as deviations from 

departnent means in department standard deviation units and are thus trans- 
fonned to a carttoi scale with moan of zero and standard deviation of unity in 
all sanples. 
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o The. ihtercorrelations among the departmentaliy-stancJardized variables for 
coitibined saitples. from several departnents constitute a EDOOled, within- 
(department correlation rtatrix. V&lidity (or other coefficients) based oh. 
pooled departmnte^ for several d^>artirBnts are equiv- 

alent- to size-adjusted itea ns-of -4^^ coeff icie nts for the sinall- 

er^-^r^tment-^leveLsanples^ Ihe use of size-adjusted averages of cof^ 
relation coefficients to sumnarize results of conparable analyses that 
have been conducted in different sanples is a well-establidied ineta-anaiy'- 
tic technique (e.g. r Mbsteller & Bush, 1954). Ihe cohtribi^tion of a par- 
ticular departmental data set to pooled wi thin-department validity estima- 
tion is a function of sanple size. 

o •There is reascii to believe that nodi of the variabilis in observed valid- 
ity coefficients for coninon predictors and criteria across "similar" set- 
tings is due to statistical artifacts rather than settihg-specific__differ- 
ences in "criterion cdntent." For exaitple,_ in an analysis of 726 law^ 
schooL valicJity studies, Lim, H^misch, Dunbar (1981) estimated that 
about 70 percerrt: of the_jrari^ _schcKDl~leyel validity coefficients 

across studies was accounted for by differences in sarrple standard devia- 
tions, estimated criterion reliability, and sat|de size, respectively. 
Similar findings have been teported for validity studies involving common 
selectiori_tests arld_ j(±> performs^ criteria in.occupational settings, (for 
exaniple, PearLten, Sdimidt^ & Hunter 1980). In the Cooperative vy.idity 
Stoidies Project^Wilson, 1979 )^ in analyses i departments 
in five disciplines the majority of department-level regression coeffici- 
ents for GRE predictors were found hot to differ significantly from the 
pooled vdthinMdepartirBnt. coefficients. Statistically sii^ficaht. devi- 
ations could be accounted for by clear outlier effects in small samples. 



Itnis, predictor/^riteri correlation coefficients (validity coeffici- 
ents) tesed on dejartmenta^ standardized data p^joled across departments 
within various disciplines — tiiat is, coefficients in pooled, _within-departtrBnt 
data matrices — maybe, thought of as apprbxiroatihg popuiatibn values, arocnnd 
which department-level coefficients may be expected to vary^ due primarily to 
statistical and saitplihg considerations (sanple size> degree of selection, 
criterion reliability, and so on) rather than context-specific validity-rela- 
ted consideratiOTS such as real difference the content of the criterion. 
For exaitpie, economics departments may differ with respect to the amount of 
course work in quantitative methodology typically required during the first 
year of graduate study. 

Questions regarding the relative cbhtributioh of GRE scores and. other 
variables in predictive catfDdsites may be addressed by applying multiple re- 
gression rrethods to p^ data matrices. Stardard partial 
regression weights for C3^ scores and other indei^rdent variables, and multi- 
ple correlaticii coefficients, for exan^e, as well as single correlations^ 

based on departmentally standardized data for several departments , spooled 
within various disciplines , may be thought of as aipproximatihg popciation 
values. If one is ccfecerned with developing regression equations a^licefcle 
for small department-level sanples, it has been found that vAien departmsnt- 
l?vel regressicai coefficients are adjusted toward corresponding "pc^xjlatioh" 
values, the resulting equations generate more reliable predictions in subse- 
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quent tuples than equaticHis based solely on local data (see, for exaitple, 
Braun and Jones, 1985). 

The foraging, interpretative rationale for pooled, vdthin-de^rtoent 
estimates of cor relation or regression coefficients rests on_ ah assunptidi 
that the departnents for v*iich data are pooled are generally similar with 
relict to the nature of tte academic tasks that students are required to 
coroplete. Ihe prograns of study offered by the departments for v*uch data are 

pooled idiould require tiie exercise of generally similar patterns of skills, 

abilities, and so c»>— especially the types of skills and abilities represented 
by the predictor variables of interest. 

_ For aceKteitdc department a logical initial criterion for pooling is 

aradCTiic disciplirre or field. A more coitgrehensiye pooling rat^ would 

involve the reasonable assunption that tasks required of students depart- 
nents representing different fields or specializations within the same general 

aicademic area are generally, similar in relative demand on, say, verbal as 
c^jpbsed to quantitative skills. Academic programs in English, history^ politi- 
cal science, and so on, may be assumed a priori to make greater donands on 
verbal abilities tiian OT quantitative abilities; for prdgraitis 

in mathematics, chemistry, physics, and so on, the c^posite is true. 

_lhis line of reasoning leads to the a priori es^ctatiOTi of hi^er valid- 
ity for quantitative scores than for verbal scores in the primarily quantita- 
tive fields ai^ the c|S)Osite pattern of validity for these neasures in the 
priitarily verbal fie^^ differences in patterns of validity for 

verbal OTd quantitative scores are carisistent with a priori expectation (see, 
foi -xanide, Willing^Tam, 1974; Wilson, 1979, 1982c, 1986a, 1986b; Bjrton & 
Turner, 1983)^* Less is knowi regarding patterns of predictive validity 
across disciplines for the analytical ability measure. 



l^plicatiGn in the Present Stud^ 

Summary statistics (means, standard deviatiais, and intercorrelatiois) 
v^re_ conputed for. study variables within each of the 97 department-level 
samples of ESL students. The FYA criterion ard original scores on the (3RE and 
other continudus variables were z-scaled by department— the rerjultihg depart- 
irent-leyel distributions means (zero) and standard deviatiiDrts (1.0). 

The origiral scores of foreign students were z-scaled using parameters for 
t±ie foreign ESL students. 



* Brauh and Jerries (1985) reported that clustering departments enpirically on 
the basis of patterns of sample means on the respective GRE ireasures provic^ 
^ u^ful tesis for aggre^t^^ data for the pwrpose estimating regression 
coefficients for the GRE scores for nenters^q cliister^ Clusters thus formed 
enpirically may includfe saitples fron different disciplinary areas, but _wili 
tend to correspmd basically to a priori clusters based oh disciplinary affil- 
iaticai that differ primarily along a verbal-relative-to-quantitative-emphasis 
dimension. 
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1. Ho evaluate levels and patterns of GEIE/FZR cdrrelatidns in general 

^np]^s of ESL^stxxfents neans of departiient-level vsiidity cipefficiehts 
( we i c^ted^ fa y sanple si z e^ - or size-adjusted ^ ijnless otherwise -^^iecified ) were 
coitputed f or each of the departitents and classifications of de£»rtitents desig- 
nated below: 

b dlemical^ civil/ electrical , industrial , neclianical, engineering^ and 
Engineering^ total 

o Statistics, chertdstry, j^q^ics, nBthenatics, coitputer science, and 
Mathematics and Physical Science, total 

b Ecoriondcs 

o Quantitative, total ( Engineering + MatlyScience + Economics ) 

6 Bibscfences (total ) 

o Social sciences (total) 



In view of the very lind ted representation of departments from bioscience 
and social science fields, primary eirphasis was placed on analysis of data for 
the 86 departitents from primarily quantitative fields. 

2. lb obtain general (pcpilatibri) estimates of the relative wei^tihg of 
^RE srores in cx^ multiple regressi^ were 

conducted using pooled niat rices of de par tnentaliy z^scaled F®l (Z^@) arid GRE 

(Zgre) data for several grotps of departments: (a) engineering (bj mathenetics 
and physical sciences, (c) economics, (d) cjuahtitative total, (e) biosciences, 
and_(f) social scierKres. Ihe siitple correlaticffi between a standard catpbsite 
bf Zgre predictbrs, based bn a regrtssibn equatiOTi developed for the total 
guontitetive sai^ cat|xited for each department-iewl sanple. 

ffeans of validity coefficients for the congosite predictor wer^ conpared with 
means, for the individual ^'E predictors to assess the potential for incrarent- 
al validity in a uniformly weighted general ccnpbsite. 

Ihe TOEFL^LEVEL scbre was included as a si:5plemsntal pre^^ in certain 
of the STBHltiple regression analyses tb assess the possibility that this vari- 
able, w? J di was thou^t differences in English-language back- 
grocffKi linked to county of citizenship, might have incremental \^idity v*ien 
included witJi OtE scores. 

? . Multiple .regression analysis of departmentally z-scaled data^ pooled 
for sub^tbl^s bf students f ram guarititative departments, was enpldyed to 
explore the possibility^ mi^t tend to vary across 

S'^roaps of foreign ESL students judged to differ in "level of ESL profici- 
ehcY*- and Englistt-language background, as defined by: 

a. score level on the Relative Verbal Performance index (R^i), 

b. score level on the. Relative Analytical Performance Index (RM^JPi), 

c. TOEFL total-score levels 
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d. self-reported BCE status versus other status. 

ttese analyses, incident provided inforrnation regarding the average 
relative within-^Jepartment standing of students in various sijbgroi^s as re- 
flected in the means on z-scaled 6RE (Zgre) scores and the_2-sc3led Fffi (Zf^j 
criterion — that is, means on Zq, Za, Zv, and Zfya. Observed mean Zfjra for the 
Proficiency subgroup involved v^re ccnpared with estimated or expected means 
|Z'^a) based on the z-scaled Zgre scores / using general re-r 

gressicn equations based on pooled z-scaled data for all departments involved 
in the analysis, ihese carparisons provided a basis for tentative inferences 
regarding the catparative performance of various subgroups. 

4. Are mtMiVHdepartmeht predictor/criterion relationships stronger in 
groi^JS that are to with respect to national brigih_than in sanples 

tiiat are heterogeneous vath re^ct^ to evaluate this 

questicm, coefficients reflecting the relationship between Z^ and a stan - 
dard ccmposi te of Zq.ahd Za scores were conputed for sanples of students clas- 
sified ty country of citizenship and world region and for sanples classified 
by world region and type of quantitative departiteht— ^engineering, matii- 
science, ecxinomics--^ for the cdribined sairple of foreign ESL students 

from all quantitative departments. 

_ Gonsi stent with the prinary objectives of the study, the foregoing 
analyses were designed to provide evidence regarding the t]5)icai levels of 
wittiirRiepartmerit relation^ and _FiA variables for foreign 

ESL sttsdents and t^^ on these relatic)nships of introducing controls for 

"iev^is of Einiglish proficiency,"^ defined, aind^^ of_ citize\P 

^ip. Biese analyses are described in detail in Sections IV through VI. 

_ Ihe stix^ was not designed to acSdress questions re^rding the comparative 
academic perforroahce of students from different countries or regional groups, 
or the extent to which level of academic performahce was consistent with level 
of perfornence. Lin^ related to these questions were possible, 

however. Ihese analyses and related findings are described in detail in 
Section VII of tiiis report. 
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Section IV: GRE/FYA Relationships For Foreign ESL Students, 

by Academic Area 



secticai presents findings regarding i^/f1si correlations for foreign 

ESL students in d^rtmerits classified by field and in broader area classif i- 
catiais. Size-^djiisted neans of jfe GRE/rm correlaticjn coeffici-^ 

ents are ^own for various classifications^ Restalts of regressicffl analyses of 
z-scaled Fm (Zf^) on the z-scaled -C^gre) predictors (Zq^ Zq, Zv) , using 
data aggre^ted for departments within broad acadeinic areas, are pres 
Also reported are trends in department-level correlations between FXA and 
three non-<3ys variables: U.S. versus other infergrac&ate origin^ 
seif- r^prted better oGonunicaticn in English (DCE) versus other status, sSd 



Interpretive Per s p e c tiv e 

One of the principal questions inplicitly at issue in this stu^ is 

whetiier (^/Fm correla^^^ for saitples of foreign ESL students are similar 
to those tj^icaiiy deserved for Scinples of U.S. students. Since data for U.S. 
students were not collected for tiie de^rtments in this stu(^, it is tiseful to 
review brief ly findings regarding typical levels arrij»tterns of GRE validity 
for predicting academic criteria in sartples coitposed exclusively or predomi- 
nantly of U.S. stixJerits. 

Biere is a substantial bod^ evidence regarding the relationship of 

scores on the well-established verbal and quantitative ability ireasures to 
performance in graduate study, typically mea5njred by first-year average grades 
ifdr example, Willin^iam, 1974; Wilson,. 1979, 1982c; Burton & Turner, 1983). 
Evidence regarding the predictive validity of the analytical ability measure 
intraJuced in October 1981, and not made operational until October 1985, is 
mudi more limited. 

Evidence re^rding ^icai levels and patterns of validity for the verbal 
and quantitative ability measures is based on cumulative findings for several 
hundred departments, _ Consistent with a priori expectation, quantitative 
scores are itlbre valid predictors than WE verbal scores in quantitatively ori- 
ented fields sudi as che^ engineering^ mathematics^ and so on, v*iile the 
opposite pattern t?pical2y hold^ verbal fields such as English, history, 
sociology, political science, education, and so on. 

o In two cooperative studies, each of \*iidi irwolved a total of 100 or nore 
departments ranging fron higWy verbal to hi^ily quantitative, median 
^^idity coefficients for verbal and quantitative scores,, respectively, in 
tSe ncrej^rbal departments were .31 and .25 (Wilson, 1979j and .27 and 
.25 (Wilson^ 1982c|. F^^ "(juantitative" departments in the respective 
studies, typical verbal and quantitative coefficients were .20 and .31 in 
the earlier stixty arri .18 arx3 .28_ in the later one. Ihe earlier stucfy 
involved scores on tests adSninistered prior to October 1977, while the 
later stud^_ involved scores on the "restructured" test introduced in 
October 1977. 
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o For 118 social d^ r Ueiits that participated in the OPE validity 

Stiriy Service (^S) at ^ thrcwgji June 1982^ the pooled^^^ v^^ 
nent vaiicttl^ coefficients ( size-adjusted averages ) for S^V airi G^-Q 
\sere .26 and ^23, respectively; for 56 ngrHiematics and physical science 
departments^ typical coefficients for GRB-V and were .12 and .27, 

re^)ectively (i^irtch & Ifcirner^ 1983). 

A ccnparable bod^ of evidemse is_ not yet a^^lable for the revised GRE 
ana3yticai ability neasore introduced in Octcier 1981. ftnalyUcal scores l^^ 
been fcwnd to be ^sitively cx>rrelated with first-year graduate school grades 
iMj^tch, 1985; Swihton, 1985) and with tmctergraduate grades (Wilson, 1984cr 
1986a) in a variety of fields. 

o Based oi fijidta Igr Kirgston (1985) ^ for gradijate cte|artmBnts 

sending post-Septecber 1981 GRE General Test scores and Fffi data to the 
(3E Validity Study Service (VSS) at ETS, the analy ^ d.caL -score vas— 
heavily wei^ted than tte ^^rtel score in predi ctive ccaposites for 
graduate engineering and nathaxatl ^sciencel derartments ^*. However^ 
questions ri^rdir^ the incrCTental ancj/dr differential validity of the 
aralytical ^ill^ fflBasure_ (for predicy.cn ^^^^ grades in guantitatiye as 
opposed to veidbal areas of stuc^r for exeonple) for U.S. or other student 
grct^ remain tnresolved. 



GR^/F^ V^dity Gdefficients for Fbreigji ESL Sairples 

l^bie 7 stews size-adjust^ raeans^of d^rtanent-lero correla- 
tions for foreigp ESt students in desigrated ^ocps of dejartanents. f^r eadi 
grasping ^ the nunber of d^rtniehts tsanples) is Swwn, alar^ with the total 
nuraber of students cn vMch the coefficient is based (see .^apendix A for dis- 
tributions of d^>artinent-level coefficients and other department-level data). 



* In evaluatir^ Kii^tch^s fiixJih^s recording ^ the analytical ability meas- 
ure> and in eyaluatijng the coef f icilrits obtained in the present jstu3^ for this 
measure ^ it should be ke^ in mind that during the ^ri^nirwifli3rtF^~"sHP 
dente_ involved were^ Emitted to graduate school^ test advised not 

to-consid er the en rialytical score in ectaitt inr r stiitents . Thus^ the predict3?i 

value of tha analytical score presumatfly was not affected by^estriction of 
range due to direct selection^ vfereas restriction dee to direct selection was 
a factor affectii^ the ccntributicn of both the verbal arid the quauititative 
scores. Ihe fact that it was riot used directly in selection ttebretically 
shoild ^fl^rge the cteerved predictive validity of the anaiytical ability 
ineasure relatiye to_ that of tte verbal euid guantitative ability ipasures. 
Studies iiTvol^Jig^nples adnaitted after October 1985 will be needed to_ 
solve questions regarding the incremental contribution of the analytical 
ability measure to prediction ijnder conditions in wfiich ail three Gi^ scores 
have been considered in selecting students. 
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Table 7 

Siiiple Ctorrelatidn of G General Test Scpres with FSA: Wei^ted 
( Size Adjusted) Means of Defsartinent Coefficients 
for Departments GroqDed ly Graduate Field and Area 



Graduate Area 




1*3. 






GRE-V 




depts 


>. stutents 


r 


r 


r 


Qngineering 


4b 


702 


.289 


.278 


.114 


Qiemical 


8 


80 


.315 


.362 


.173 


Givil 


8 


162 


.163 


.088 


-.047 


Electrical 


10 


256 




. jtyj 




iTKiostrial 


6 


89 


.400 


.342 


.165 


Morhanical 


8 


115 






1 HA 
• ±\Jh 


JHatlVScienoe 


36* 


37.3 


.351 


.268 


.023 


Statistics 


5 


54 


.330 


.425 


.189 


Chemist 


10 


111 


.353 


.190 


.012 


Mathaiatics 


4 


39 


.602 


.266 


-.013 


Siysics 


6 


51 


.452 


.452 


.011 


Gcnputer Sci 


10 


113 


.249 


.220 


-.013 


Eocnomics 


10 


138 


.313 


.282 


.210 


ALL Quanti- 












tative 


86* 


1213 


.311 


.275 


.097 


Bioscienoe 


6 


55 


.061 


.081 


-.023 


Sdc Sci 


5 


85 


.116 


.184 


.253 



Note, ^ coefficients shov^^ are "size a^^ averages of departnent- 

level coefficients (i.e.^ v?eighted according to sanpl^ size) for sairples 
of five or nbre nonnative Engii^i-speaking students. 

* Includes data for one applied mathematics department (N » 5). 
Table Diskette 546.84 Doc. 18 page 1 
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o For foreign ESL students in ail subgroups of "quantitative" departments, 
6RE quantitative scores and ®E analytical scores v?ere itore hig^y 
correlated with ITYA than were GaRE verbal scx)res. 

o Ihe basic pattern of C3^ \^id^ across the respective types of quahtita- 
tiyely oriented_ f^^^ is suggested ty coefficients based on the_ total 
quantitati\^ sagple of 1,213 students, nanely, . 3^ for 
quantitative, analytical, and verixd. scores, respectively, notwithstanding 
the fact that coefficients for ahalyticai scores vgere higfier thai those 
for quantitative scx)res in several fields. 

o 3ie jJattern of cxn|»ratively stronger validity of the analytical ability 
scores relative to the -^i^ scores in Uiese ESL sairples 

is consistent with Kingston's (1985) finding^ for s^nples f rom vMch ESL 
students (U.S. as well as ndrh4J.S. citizens) were exclirfed. 



For the small sairple of 85 stidents from five social science departnehts 
(four front education, one from political science)^ verbal scores were itbst 
valid, and q^^tltati^ so^ least valid: cbefficierits for vex^LL, 

affiaJyticai, ani quantitative srori^jv^r^ respectively^ .253, .184, and .116. 
ihe pattern of hi^ier validity for verbal than for _quantitative scores in this 
ESL sanple in vfeLch education, students predomihated is consistent with that 
reported by the VSS_ for 17 education samples (.26 and .19 for verbal arid 
quantitative re^jectively^-^rtbn & Turner, 1983). 

F^r the six bioscience ^irples with a total of 55 st^ 
for quantitative scores airf anaiytirai scor es w ere positive but atypically low 
and of about the sane magnitude (.061 as ccnpared to .081), vMie the verixd 
coefficient was anomalously negative. 

The QPE/FYR correlations in Table 7, except for those obtained in the 
limited bioscience sanple, appear to be carparable to coefficients that have 
been found for U.S. stuCents, as reviewed at the beginning of this section. 



Multiple Regression Results for Foreign ESL Students Academic Area 

TSble 8 shov^ selected findings of multiple regressicni analyses based oh 
departnBn^'''ly standardize^ broader grdt$)ings of depart- 

ments^ engi^ieering, mathematics and j^^ical sciences, economics, all quanti- 
tative, biosciences, and social sciences, respectively. 

_ Ihese result_s indicate the limited contribution, of verbal scores to 
predicticn of Fffi in the primarily quantitative fields^ with the possible 
exception of economics. 

The patterns of regression coefficients tended to be quite similar for 

the respective quantitative areas. Coefficients based an aggregated data for 

the engineering, math/science, arid econonics departments were similar to those 
for the combined quantitative-department sanple of 1,213 foreign ESL students. 
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Table 8 

Regression Results for ESL StiKtents Using Departirehtally StancJardized 
Data Pooled hy Graduate Major Area 



Correlation vdtfa^^ Beta ^^ht* R 



Field/Area 


N 


Q 


A 


V 


Q 


A 


V 




Qigineering 


702 


.29 


.28 


.11 


.21 


IS 


.01 


.33 


MatiVScience 


373 


.35 


.27 


.03 


.29 




-.08** 


.38 


Economics 


138 


.32 


;28 


.22 




TT5 


.12 


.38 


All quant 


1213 


.3i 


;27 


.10 


.24 




-.01** 


.35 


Bioscience 


55 


.06 


.08 


-.02 


.03 


.09 


-.02 


.10 


Social Sci 


85 


.12 


.18 


.25 


.05 


.08 


.21 


.27 



* Standard partial regression coefficient. Urrierscored coefficients-are 
statistically significant at p < .05 . 

** Nfe^tive wei^t indicates suppression; note positive siirple correlation . 
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V&lidity of a Sl^idard Gl^ Predictive Ocmposite 
£or Quantitative Depattnents 



The similarity in regressicHi results for engineering^ inath^scieric«i_arid 
econcmics degarl^ the potential utility of a standard GRE pre- 

dictive caraposi^inclu^ only guantitative^^^^ a^ 

with wei^tts specified by regressicxi results for the contoined sample of 
students from all quantitative departments. 

A cdnposite of deEartroentally z-scaled quantitati\^ and analytical abili- 
ty scores (Zg arii Za) weigfited to predict z-scaled Fm. in the cotbirpd quanti- 
tetive saitple ccn|xited fo^^ Za. Hie sinple 

correlation between this staxJard ccnposite and the criterion v;as determined 
for each department-level sanple. 

T&ble 9 shows the ireahs ( si ze^d justed) of the department-level coeffici- 
ents for this staixjard conpdsite (last roluirri of table) for quantitative de^ 
partatents classified by f^^ major area. Mean coefficients for the indi- 

vidual GRE predictors (from Table 7j are included for perspective. 

the results in Table. 9 indicate that the standard cdnposite had general 

validity for predicting relative wi thin-department standing for departments in 
the three general qijantitative areas: engineering^ inatlv^cience, arid ecdnoctH 
ics. For these three areas ^ coefficie^ for the standard ccnposite were 

scxiev*Ht hitler than coef^^^ for the M^est single ^red^ (^^ically 

quantitative ability). Observed differences between coefficient for the 

composite predictor and that for the best single predictor ke^ be thou^t of 
as reflecting reasonable estimates of the anourit of incremental validity 
involved in using a ccnposite of tyo GRE scores, (figain^ it is important to 
recall that the analytical score probably was not used directly in silection ). 



Sinple Correlation of Selected NarHGI^ Vctriadbies witji Fm 

5^1e 10 shews, size-^justed coefficients summarizing trends across 
departments in the relative ac^emic_ performance of students \*io (a) reported 
BCE statnjs (better conit^^ English than in any other language) versus 

other status and (b) reported attending a V.S. undergraduate school versus 
other status. Positive coefficients indicate hig^r mean Fffi for tiiose \d.Ui 
BCE status and for tiiose reporting a U.S. undergraduate schocd. Size-adjusted 
coefficients reflecting trmds in the relaticHiship between iCEFlr-EEVEL. scores 
and F2R are also shown in the table. Ihe nuniber of departments involved in 
the respective analyses varied; in several departments, no student reported 
BCE status or no student reported a U.S. landergraduate school. 

Sie varisCle called T^Ir-I£\^ ras essentially mreiated to rd^ in the 
scfftples studied, la analyses not reported in Table 10^ it was found that 
TOEFL-'LEVEL ^did not have incremental validity when included in a battery with 
the GRE predictors. 
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I^l e 9 

Validity Coefficients for a Starrfard ea^site of (^ Quantitative and 
Analytical Scx)res versus Coefficients for Individual Scores: 
Size-Adjusted Averages of Department-Level Coefficients for 
Quantitative Departments Grou^jed by Fields and Major Areas 

Graduate Area Ife. No. GRE-Q C^E-A Qii|x)site* 

depts. stcdents r r r r 





^n 






.Ho 


.±14 


.330 


Chemical 


8 


8b 


.315 


.362 


.173 


.402 


eivil 


8 


162 


.163 


.088 


-.047 


.155 


Electrical 


10 


256 


.296 


.340 


.185 


.372 


Industrial 


6 


89 


.400 


.342 


.165 


.430 


Mechanical 


8 


115 


.347 


.300 


.104 


.354 




36** 


373 


.351 


.268 


.023 


.370 


Statistics 


5 


54 


.330 


.425 


.189 


.422 


_ Chemistry 


ID 


111 


.353 


.190 


.012 


.340 


Mattematics 


4 


39 


.602 


.266 


-.013 


.521 


Physics 


6 


51 


.452 


.452 


.Oli 


.522 


CosTputer Sci 


10 


113 


.249 


.220 


-.013 


.283 


Eooncmxcs 


id 


i3r 


.313 


.282 


.210 


.370 


All Quanti- 














tative 


86** 


1211' 


.311 


.275 


.097 


.347 



Nbte ^ Ite coefficients shorn are "size adj^us departitent- 
level coefficients (i.e. , weighted according to sairple size) for sanples of 
five or more foreign English-second-ianguage (ESL) students. 

* The entries in this column are size-adjusted averages of departiteht-levei 
single correlaticHi coefficients between Z(fya) and a standard conpcsite of 
depar LmenkaUy z-scal^ GRE guantitative, Z(qh scores and analytical^ 
Z(a), scores^ wei^ted^ccording to results of^ regression of Z(fya) on 
Z(q) and Z(aj in the contoihed sample of stoJents (N ^ 1,213) frcan all quan- 
titative departments: Predicted Z(^) = Z'(fya) = .238 Z(q) + .176 2(a)- 



** Incl\^es one applied mathematics department (N = 5) for v*iich data are 
not shown separately. 
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Table 10 

Sinple Cbrrelatic»i of Select^ Size-nfidjiosted 
Means of bepartraent-Level Coefficients for Departitents Grouped 
by Graduate Field and Area 



_ _ _ TDsir4£WEL Self-Beported U.S. ttidergrac&ate 

Field ._ BCE«1 schcxfl. = 1 







(N) 


r 


No. 


(N) 


r 


Nb. 


(N) 


r 




depts. 




depts. 




depts. 




Bngineerincf 


40 


762 




37 


679 


—.005 


37 


tS66 


—.226 


Clieinical 


8 


80 


-.073 


6 


66 


-.090 


8 


80 


-.116 


Civil 


8 


162 


-.133 


8 


162 


-.098 


8 


162 


-.204 


Electrical 


10 


256 


.152 


10 


256 


.048 


10 


256 


-.236 


indastrictl 


6 


89 


• 111 


5 


80 


.122 


2 


30 


-.285 


Medhahical 


8 


115 


.028 


8 


115 


-.138 


5 


75 


-.300 


Kitlv'Sciehce 


36* 


373 


-.078 


29* 


301 


-.094 


23* 


243 


-.210 


Statistics 


5 


54 


-.052 


5 


54 


.042 


3 


36 


-.030 


Chemistry 


id 


111 


-.117 


8 


90 


-.202 


5 


50 


-.420 


MathertBtics 


4 


39 


.037 


2 


26 


-.026 


3 


34 


-.288 


Physics 


6 


51 


-.135 


4 


27 


-.155 


4 


38 


-.188 


Computer Sci 


10 


113 


-.039 


9 


104 


-.017 


7 


85 


-.093 


Econanics 


10 


138 


.030 


6 


98 


-.207 


6 


99 


-.171 



ifli Quanti— 



tativB 


86* 


1213 


.001 


71 


1078 


-.046 


65 


948 


-.219 


Bic^dehoe 


6 


55 


-.017 


4 


41 


.115 


5 


49 


=.029 


Soc Sci 


5 


85 


-.017 


5 


85 


.101 


5 


85 


-.142 



Note ^ coefficients ^xwn are "size adpiasted" averages of department- 
level coefficients (i.e., wei^t^ according to sanple size) for saitples 
of five.or more ncinnati>^ ElhglisH^speakihg students. WEXJx-lSfiillj « IDEFL 
iteans of U.S.^bcwnd TOEFL exaitdnees by country ascribed to citizens of the 
rei^ctive countries in present sanple. &lf^ better 
coninunica tion in g^glish than in any other language versus other status. 
U.S. undergraduate schooi = designated a U.S. scfipol versus other. 

* Includes one applied mathematics department (N = 5) for vAiieh data are 
not shown separately. 
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o Size-adjusted meaais of TOEFir-LEVa^/B^ coefficients were .035 (all engi- 
neering sairples)^ -.078 (mathematics and piysical sciences), .030 (ecOTiom- 
ics), -.001 (all quantitative) > -.027 (biosciences), and -.017 (social 
sciences) . 

o fiiese cbeffici^ no systematic teiidencies across departirents 

for academic- staixJinc to vary with national origin as indexed by historic 

country-level means on the TOEFL._ In evaluating this OTtcome, it should be 

reoDgnized (aj that only, a very limited nunter of cotStries could be rep- 
resented in the very small department-level saitples, (b) tha> the range of 
teckground differences iridexed by this variable was correspondingly re- 
stricted, and (c) that the particular mix of countries was not constant 
over departments. 

_ coefficients for BCE status indicate that there vas no systeanatic tenden- 
cy for students reporting better coitinunicatiOTi. in English to earn better 
grades than others. In fact, for quantitative fields, the opposite pattern 
tended to be slightly more prevalent as indicated by the negative coeffici- 
ents, BCE coefficients were positive, but lov/, for biosciences and social 
sciences. 

Ihe siz^-ad justed mean cor relation for U.S. versus other tiidergraciuate 
sdiodl with FYR was negative for every academic classification, Ihis indicates 
a relatively strong tendency across departments for foreign eSL students who 
reported attending a U.S. i^ school to earn lower grades, on the 

average, ttian their counterparts v*id did not do so. 

o In evaluating this finding, it is useful to recall (fr^ Table 6) that 
students with U.S. undergraduate origins had lower average scores oh all 
three GRE variables, especially on GRE quantitative^ than their counter- 
parts v*io ccnpleted their undergraduate studies ^ilsev*iere. 
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Section V: Felatidnships for SiiDgroi^JS Differing in 

Perfonnance on Selects Ehglish-Prbficiency--Felated Measures: 
Pooled z-scaled Data for Quantitative Departnents 



; Ihis section presents findings of regression analyses based on pooled 
z~scaled_data for subgroups of foreign ESL students f ran quantitative di^rt- 
ments only. Analyses were not conducted for students in bioscience and social 
science departnents. 

Bie analyses were concerned with trends in Zgre/Z^a relationships across 
subgrotps differing in relative level s of "ESL proficiency " as measured by ia) 
the RVPI trelative verfaai perfonnaiKg index), (b) the raNPI (relative aiialy^ 
UctI perfonianoe inq^) > (c) self-reported better ccmaaurdcation in aigli^ or 
BCE status versus other status^ and (d) scores oh the TOESI.. Ihe question 
generally at issue v^s v*iether validity coefficients would tend to be higher 
for subgroups vdth hi^er levels of Ba^ proficiency than for those with 
lower levels, as indexed 1^ the respective measures. 

_ With regard to the three test variables, the conpaiatively low intercor- 
relations reported previously (Table 6) indicate that the aspects of "ESL 
proficiency" involved in processing the verbal content of the analytical 
ability items are not very similar to those involved in processing ORE verbal 
or TOEFL items. 



Prc»cedures Involved in Defining Subgroups 

For the IWPI^ the JRBNPI, ard the lOEETi, respectively > score levels for 

"hig^^ ••medium," and^^^ were set in sudi a way that if the 

respectiA/e score distrib^ were tTOtmL, aboi^ stu^its 
wcwld be in eadti grotp. ^his was approximately true for RANPI and TDEFL. 
However, the. distribution of R^i scores was skewed positively — about 47 
percent of all students were in the "lc«?7" category, as compared to 23 percent 
in th^ "high" category; all_ deEartngntr-level sarrples were heterogeneous with 
respect to scores on the RVPI and RfiNPl measures and sate representation in 
eadi score-level was assumed for the majority of the sanples. 

_ With njsi^ct to the self-r^rted BeE status variatble, fourteen ofJJie 86 
department-level sanples included no sttxient who reported better communica- 
tion in English. Ihis was taken into account by forming three subgrotps for 
analysis: an "English better" subgroup and ah "bther_ language better" stiDgrotp 
for sb^ents from departitients_ with at least one BCE student^ plus a third 
stfcgrocp inclxding "other language better" students from 14 departments with 
only non-B^ students enrolled. 

^K^FL scores, were unavailable for a stjtestantial proportion of the stu- 
dents. Three TOEFL^score subgrotps were formed for 769 stiadents frcm 75 de- 
gartirents ri^resented 1^^^ five students with GRE/Fm scores, at least 

one of v*iom aJ-so had a TO score. For 10 d^artments in v*iich at least one 
but fewer than five students had TOEFL scores, the available TOEFL scores were 
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z-scaled using jarareters for W^EIi/VER^^ TCKFL score esti- 

nated frcxn ORE verbal score). A total of i§8 students from the 75 departments 
had GRE and Fa data, but ho TQE3sTj scx)res. 



Results 

l^ie^2 sunraarizes tte principal finding of tiie regressic^i analxses: 

means of Zgre scores and mean Z^^a for eadi subrocp, sinpie Zgre/^l^a correl- 
aticaisJ?ase3 on fxxDled z-scaled data for the stAgroops, and multiple correla- 
tions, for Zgre catposites, qite invplyihg caUy quantitative (Zq) and analyti- 
cal (ZaJ scores and the other inclxxiing_ all three GRE scores {Zq^ ZSa^ Zy). 
Ztoefl/Zj^ coefficients as v?e^^^ are shown for the 

TOEFL sanpie. Findings t>ased on the total quantitative sanple are also shown. 

Overall, the findings do hot inclicate a consistent tendency for Zgre/Z^a 
correlations to be "iSoderated" by "level of ESL proficiency" as defined by the 
variables under consideration. 

o Levels of Zgre/Z:!^ relationships did not tend to vary directly with 

ievels^f prof iciency defined in terms of relative -verbal perfontianc e, 

relative analytical performance , or sel f-reportecU sngti^- catiwjiication 
stati:^ . In analyses involving TOEFL as _ the elassificatoxy variable^ only 
for the subgrqijp with TpEFL scores of 585__plias (at atSut the ei^ty- 
seventh percentile for all graduate--level TOEFL examinees) were Zgre/ZI^ 
coefficients (.37,^36, and ,18 for Zq, Za, and Zvr re^ectively) notice-^ 
ably hi^er tten those for^^^te ( .Bl^ .27, and 

.10^ respe ctiv ely) ; corresponding multiple correlations were .44 as 
ccnpared to i35i 

Interpretation of correlational results for classifications based _cffi 

TOEFL total score is complicated by the fact that differences in Zgre/Zi^?a 
correlation associated vd.th "availability v^ nonavailability of TOEFL 
total score" were more pronounced than those associated with differences in 
score level among students with T^Ft scores. 

o The multiple correlation for Zgre composites in the "No lOEFL" subgroup 
was only R = .22j,_as ccnpared to multiple correlations of .36^ „*34^ and 
.44 for "Yes TOEFL" students in lower, medium, and higher ICHFL-score 
clasEvfications, respectively. 

There is ho reacty explahatiOTi for this iSanticipated pattern of finding 
regarding TOEFL* It is difficult to attribute the c^Dserved differences in 
level of ^re/Z^a correlations, between the "Yes TOEFL", and "Nb T^^L". sii>- 
grdips to English^rdf iciency related factors . For exaitplei .the mean relative 
vrtUiin-;;departirent staaxiing of the "Nb TOEFL" sutgrotp on GRE_ verba^ vas about 
the same as that for students in the middle TOEFL-score range---mean Z^a « 
-0.69 as ccnpared to -0.11). Biis suggests that the "No Ti^St"^ttdents (pre- 
sumably screened for ESL proficieh<^ other means) were rou^dy cotparabie 
to_ "Yes TOEFL" students in terms of the type of "ESL proficiency" measured by 
GRE verbal items. The "No TOEFL" ard "Yes TOEFL" suhgroips were also roughly 
comparable with respect to relative standing on analytical ability, but the 
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GRE/FYA Relationships for iSubgroups Defined by Re 1 a cl v e S c a nd I ng on S e 1 e c c e d _ ES L- P r o f 1 c 1 e n c y-Be 1 a c ed Tesc 
or Self-Reporc Variables in Ah a 1 y s e e Us i ng be p a r c me n c a 1 1 y Standardized P r ed i c c o r / Cr i c e r i o n Da c a 

Pooled Across Quancitacive Deparcmencs 



Variable » 



(N) 



Zf ya-^->: 



Z-scaled mear 



Zgre-q Zgre-a Zgre-v 



Zgre-q 



greAfv^a 



Zg r e-a 



Zg r e-v 



— Mui ciple correlac 1 on 
Zq , Za Zq , Za ,~Z V 



RVPI high 2B9 d.di (0.03) 

RVPI laed 35 2 -O.OA (-0.07) 

RVPI I5w 572 0.02 (O.Ol) 

Relacive Analyctcal Performance Index 



_RANPI high 


391 


0 


lA 


(0 


. 17) 


RANPl medium 


A99 


0 


02 


C-n 


01) 


RANPl low 


353 


-0, 


IB 


(-0 


.15) 


Self-reporced BCE Scac^^ 










Ehgltsh betcer (a) 


198 


-0. 


09 


(-0, 


01) 


Ocher betcer (a) 


883 


0. 


02 




00) 


Oc ler bccccr (b) 


132 


0. 


00 


(0, 


00) 


TO E FL v'otal Score If 0 












585 + 


252 


0. 


09 


(0. 


11) 


550-584 


265 


0. 


15 


(0. 


02 ) 


Less Chan 550 


252 


-0. 


07 


(-0. 


07) 


No TOEFL 


196 


-0. 


22 


(-0. 


08) 


Total ]2I3 








0. 


00 


+ + _ _I_n I C i_a 1_ _ e n t_r y l s 


the 


observed mean. 



:0. 15 

-0.2 0 
0. 20 



0. 36 
:b. 15 
-0.08 



_1 .07 

:0.02 

-0. 53 



. 28 
. 2 9 
.35 



.23 
■ 32 
. 28 



. 15 
,16 
,11 



;30 

.36 
.37 



30* 
\6 

:• 7* 



-0. 02 


0 


.98 


o:46 




. 3A 


. 30 


. 1 1 


.36 


.36 


0.00 


-0 


.08 


-o; OA 




. 30 


.25 


.02 


.30 


, 30* 


0.02 


-0 


. 90 


-0. 30 




. 30 


.2A 


.id 


.32 


. 32 


-0.06 


0 


OA 


0.51 




.35 


.27 


. 10 


.38 


. 38* 


0.02 


-b. 


01 


-b. 11 




. 30 


.27 


. 12 


.3A 


. 3A . 


o:oo 


0 


00 


0. 00 




. 3A 


.33 


. OA 


.40 


.Al* 


Q. 1? 


0. 


AO 


0.75 




.37 


.36 


.i8(,i5) 


.A3 


. AA ( . AA ) 


P . 1 1 


-Q. 


02 


-Q. 11 




.25 


.31 


. 1 2 c: i 1 ) 


. 3A 


. 3A( . 3A ) 


-0.0 7 


-0. 


31 


-0.55 




. 36 


.23 


: 0 1 ( . 12 ) 


: 36 


-36 (.36) 


-0.2 7 


-0. 


07 


-0.09 




- 2 I 


. 12 


.06 


. 22 


.22* 


d.db 


0. 


00 


0.00 




. 31 


.27 


.10 


,35 


.35* 


The entry in 


parentheses 


is z- 


scaled 


mean es 


timated from Zgre 


- q a nd 


Zgre-a, _u3ing 


or the 


total 


quant i t a t i v e 


sampie 


(N ~ 


1.213): 


Zfya(est) - .238 


Zgre-q 


+ .176 Zgre-a. 



»^t ^la^4ve Verbal Perfomance Index : The discrepancy between the observed: GRE verbal score and GiiE verbal score p r e d i c t e d f r om 
^"^"^V'^^l^^ve score using a regress ion equatlpn, b_a8_ed..j5.n_ _dat^_ for. D. S . GRE examinees. Relative / rialytical Performance Ind^: A 
comparable discrepancy i ndex invo 1 v ing oAsjeryed analytical .ability scjj.re a_nd analytical s c 6 r e p r e d I 5 1 ed frbm " q uan I: i t at i ve sc ore 
reKT^fsalon equation. Sel f - Sspo ir^^ BCB a t A rua ; S e 1 f - r e po r t ed rt^latlve c ommQ n r r « t r u ^ i bll i t y , e 1 1 h e r better In 
"'^^^^ C») categoriea i n c 1 ud e o n i y s t ud e n t_8_ _t r om de p a c t roe n t s in which at least 6ne student 

(b) includes data for departments in which al^ students reported better communication in a language other 



using a S 
Lngllsli or - better 
reportedBCE statu 
Chan English. 



ff^The TOKKL .inalysls was. based 6n pooled data for 967 students from 75 departments with five or more studlents with complete GRE/ 
FYA^dat.i._ at least one of whom alax* had a toEFL total score. A total of 769 students from these departments had GR_E, FYA^ and 
TOKFL^^cores. and 198 had. liRE and. FYA oiily. Where TOEFL N-waa lesi Chan 5 for a department. TOEFL was z-scaled with reference to 
p.ir i.^L'ters f ur rOhFL/VERBAL, a _v a r i a b l_e_ de f in e d as either TOEPL total score (when availabltl or estimated TOEFL (from GRE-Verbal) 
^": '^V"^*-*'V^*^ without TOEFL. Coef f ictents .i_n._Pa_r.e_nth.e.s.ea ladLcate either atraple Ztbefl/Zfya con 
tlon obtained when Ztoefl was substituted for Zgre-verbal in the analyals. 

* Weight For Zgre-verbal is negative (suppression) in this composite. 



rrelation or the multiple coi'rela- 
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"Nb TC^FL" subgrotp ras lower in terms of quantitative abiii^ (b^ ~0,27 
withina-Hdepartinent standard deviations, on the average, and correspondingjy 
lower in Bean DHh (by ^.22 staricJard ijmits). 

__ j For toe rei^cti^^ su^ in the total quantitative sairple, adding 

the analytiral score ( Sa) to tlie GRE quantitative score (Zq) yielded scite in-^ 
cronent in validity, txit incltxiing the verbal score (Zvj or the 
total score (Ztoefl) did not yield any increments in validity. 



GcinparHtive E^tfotiiBride of l^±)grdu|>s 

^ virtue of the process of z-scaling, means of each departatent-level 
saiiple, arii_ for all aggregations of data involving intact department-level 
sanples of forei^i ESL students, were 0.00. For _si£grot5)s within a departitehtr 
or for aggregations of data involving selected members of departmental sam~ 
gleSi the Rteans of 2-sc2iled yar^ iridicate, in standard iJhits^ the average 
deviatiOT of subgroi^nBrrters from the means of 1±9ir re departments. 
For exanpie, the Zf^ means in the R\7PI analysis were ^.01,^.04, and 0.02 
for jneitibers of the hi^, medium, and low R\^i subgroups, respectively. Ihe 
"medium RVPI" subgroup mean (^.D4) indicates aa average F2a that ras .04 
standard units below departmental FX}^ means; other z-scaled means may be 
interpreted in the same way. 

Predicited or expected average starriing on the z-sraled Fffi (z^a) criter^ 
:loh was carputed for each subgrocp based on z-scaied quantitative and 
z-scaled analytical scores only, using the: total quantitative sOTpie regres- 
sion equation: Predicted Zfya = Z/fya = .238 Zq + .176 Za = Q.90- These est- 
imated itieans are shown in parentheies following the observed mean Z^^ for 
each subgroi^). 

Overall, the average relative withir«iepartTOnt academic standing o^ 
respective subgrotps was generally consistent with e^^ctation based cn their 
relative standing on GBE quantitative and analytical ability. 

The limited predictive role for GRE verbal is pointed tp by the fact that 
hi^er said lov^r "ESL pro^^ groi^^s in eveiY analysis were ^ dif^ 

ferentiated in terms of mean verbal score (mean Zv), but the direction of mean 
Zfya differences ves hot necessarily consistent with the direction of the 
verbal score differences. This pattern is epitomized results of the FVPi 
analysis. 



o Students in the hi^ RVPI grotp and students in the low RVPI group had 
2-scaledFYAs average rei^ctively; their FY2\s were 

typical for their respective departments^ However, they differed by about 
1.6 standard deviations, oh the averagfe, with respect to z-scaled ORE 
verbal scores: hi^ RVPI students averaged 1.07 starriard tahits above de- 
partmental verbal means v*iile lew RVPI students, typically, were 0.53 
standard units belcw departmental GRE^verbal means. 
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Section VI : Correlation rf^ Standard Zgre Predictive Gdcpbsite witii 
Zf^ for Foreign ESL Stvdents Classified by N&tibnal Origin 
arci Graduate Major Area — EJata for Quantitative Depar^^erits 



Results reported in preceding sections indicate substantial general vai-^ 
yity (across t^)es of quantitative deFartinents) for the standard conposite of 
quantitative and^analytical sro specified the regression _bf z^a on Zq 
and Za in the contoined quantitative saitple — naitiely, .238 Zq + .176 Za. 

Ihis section presents data cn the correlation between this general pire^ 
dictiye corpbsite and Zfya (a) in sanples of sftdents, (N > 9 onJy) from all 
quantitative departments ccxtibined, classified hy_ country of citizenship and by 
regions defined for the stucfy^ and (b) in saitples classified by both region 
arri graduate major area— tiia^ niath-science , and econotnics. 

Ihese_ classifications introduced some control for linguistic^<naltural-educa- 
tioml.backgrouixi variables associated with national origin, as well as for 
type of quarititati\^ major. 

Ihe analyses were concemed in part with assessing the consistency of the 

relationship between a standard predictive catpdsite, wei^ted to maximize the 
nwltiple correlation of and Za with Z^ in the general cjuantitative 

sanple,. across the sdDgroi:ps defined ^olly or in part by national origin. 

Also of interest vas the question of vtether the correlation between Z'^?a 
(the predicted z-scaled F2A) and Zf^ (the observed z-scaled value) would tend 
to be stronger in subgroups that were honibgeneous with respect to nation- 
ai-iinguistic-cultural background than in the heterogeneous general sarple. 

Table 12 shows sinpie correlations between Z'^ and Z^ for larger 
national contingents within desi^iated regions and for all students front 
countries in the respective regions. Oliese analyses are based on pooled data 
for all quantitetive "departoe Table 13 shows corrparable coefficients for 

students classified by region and bp/ type of quantitative major. 

As noted earlier, the sulgrouping within regions (for exaitple, Europe I 
versus Europe 11, Asia I versus Asia II) was designed .o take into accburit 
differences in cJiaraeteristic patterns of English language acquisitiOTi and 
usage aric^/or in the typical TOEFL scores of caitingents of U^S. -bound students 
fron tile respective cburitries. _No country from Africa i or /inerica I was 
represented as mar^ as 10 sttdents. 

Students from Category I countries as coitpared to those fron countries in 
Category II are assumed typically to have "richer English language back- 
grounds." the findings in Table 12 and 'i^le 13 irrficate that the introduction 
of control for national-linguistic origin did not have a systematic influence 
on the level of relationshipi between Z'fya and Zj^. 

o Coefficients for CategoiY I national regional contingents in Table 12 
appear to be conparable to those for Category 11 contingents. 
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Table 12 



Table 13 



Obrrelation of a Ocitfosite bf-Z^Scaled^^S^ Quaht:ltatlve (Zq) and 
Analytical (^)^Sc6ces_hdth_ZrScaled FZK^ (Zfya) for Subgroup 
Defined by CXxjntry and Region: All Quantitative Fields 



Osunhcy/Region 


N 


r 


Country/Region 


N 


r 


France 


13 


.39 


India 


176 


.37 


West_Gennany 


17 


.41 








Spain 


13 


.11 


Asia I 


188 


.34 


Burioije I 


62 


.36 


Hong Kong 


31 


.40 








.^apaii 


40 


.32 


Greece 


40 


.54 


Korea-- - 


146 


.50 


Turkey 


17 


-.24 


Malaysia 


21 


.23 








^istan 


21 


.09 


Biinspe II 


78 


.42 


Peoples' Rep 


4l 


.49 








Taiwan 


294 


.19 


Ifibanan 


12 


.15 


Itiailaiid 


20 


.30 


Iran 


61 


.28 














Asia II 


643 


.34 


MidDaGt 


98 


.26 














All stufents 


I2l3 


.35 


Afri^ I 


17 


.65 








BOTt 


13 


.60 


Note. Ttie predictive coqposite was 








specified .238 (Zq) + .176 (Za), 


Africa II 


33 


.48 


with weights based on thfr regression 








of Zf^ dh Zq and Za in the pooled 


series I 


6 


.29 


natrix - of -deparfinentaliy 


z-saaled- - 








data for.stLxjents fraDLdll..guantita^ 


C lie 


16 


.39 


tive departraente. Ooefficiente tabled 


OoiGnbia 


13 


.43 


indicate the sijiple correlation 


Nexicx} 


15 


.35 


l^tv«eh the predictive ccnpssite and 








Zfya in the subgroms desioiated^ 


Merica II 


86 


.32 









_ Opeffjcients are shawn^ _ 

for countries represented by 10 or nore students in the total quantitative 
sax^e^ regichzil coefficients include dsta for all students frcia a region. 
Tfii^f-for exanple, the total of 62- stixients froni^ Europe- I included 17 from 
West-GenEany^ 13 froiiL France^ ---aj^l3-f run Spain, plus 19 from other countries 
in the region. (See Table 4 for conplete emineration of countries in regions.) 



Obrrelation of a Cbi^XKSite of-Z^^Scaled-GliE (Zq) and 

Analytical XZa) .Scores _vdtb Z^Scaled-FXB^( Zfya) for Subgroups 
Defined by Region and Major Graduate Area 



Itegian 


N 


E^igin- 
eering 
r 


N 


Kath- 
Scienoe 
r 


N 


BOD- 

noKics 
r 


N 


All 
Qiaht 
r 


Europe I 


29 


.35 


18 


.72 


15 


.09 


62 


.36 


Europe II 


49 


.47 


20 


.47 


9 


.07 


78 


.42 


nideast 


76 


.22 


20 


.45 


2 




98 


.26 


Africa I 


10 


.69 


5 


.79 


2 




17 


.65 


JSriok II 


16 


.39 


9 


.64 


8 


.49 


33 


.48 


/oerica I 


0 




3 




3 




6 


.29 


Anrica II 


35 


.29 


27 


.35 


24 


.30 


66 


.32 


Asia I 


112 


;35 


66 


.29 


8 


.60 


186 


.34 


Asia II 


374 


.31 


203 


.34 


66 


.51 


643 


.34 


AH Be9^as 


702 


.33 


373 


.37 


138 


.37 


1213 


.35 



Note . The predictive cogxjcite was specified fc^ . 238 IZq) + .176 (Zaj - O.Qc a 
regression e(|iiation based on the pooled natrix of departnentally z-scaled c^ta 
for 1,213 students from^all quantitative fields. Ihe coefficients tabled rep- 
riesent-the sis^e correlation between this coqposite ai^ Zfya for the designa- 
ted subgroups. 
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o Fbr 22 subgroups (hy region and type of quantitative najor) with coeffici- 
ents in lable 13, the itssdian coefficient was r = .37, 

o For the 26 comtry contingents shown se^^rately in T^le 12, the raedian 
validity coefficient for the starriard carposite was r = .36, and for the 
nine regional contingents the median was r = .34, conpared to the general 
saiiple coefficient of r = ,35. 

results in T^les 12 and 13 indicate that the correlation between the 

z-sealed criterion and the standard ccHTposite of z-scaled predictors tended to 
be relatively consistent for sttgroops defined in terms_ of national origin 
ark3/or academic area. Correlations did not tend to be higher for subgroijps 
that were hanpgeneous than for those that were heterogeneous vath respect to 
national origin. 
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Section VII: An ESq^ldratdty Analysis of the_ "aiTparatj.ve Performance 
of Regicral Su^roijps on FYA and Gi::i2: Variables- 
Students from All Quantitative Departments 



Consistent with the primary objectives of this stui^, the analyses 
rej»rted in the preceding sections _ were designed to assess the patterns arri 
levels of correlation bet^ FYA criterion arxJ the_ ORE predictors and the 
possibility that GR§/Fm relationships might be affected by introducing 
controls for selected Engiish-proficiency-related test and background vari- 
ables or for national origin. 

_ _ The average levels of withirSdepartinent GRE/lra& correlati terried to be 
similar for^nples of fore ESL students fran different types of gnr^nttt^- 
tiw de|^rtments--engineering, ma^^ econanics. Based bri analj^is of 

departittehtally z-scaled data pooled across_ various conibinatidns of quantita- 
tive departments, the level of predictor/criterion correlation v^s not influ^ 
ericed ty introducing controls for level of "English proficiency," variously 
indexed, or for natiiDnal origin. 

This section descrites a ^^s^^ exploratory analysis of (a] dif- 
ferences in the average academic performance of students in the regional sub^ 
groi55s defined for the stixiy and (b) the extent to jMch subgroup differences 
in average academic Eerformance tended to corresporxi with observed differences 
in average GRE performance. The analysis was based on data for the cottoined 
saitple of students from quantitative departments. 

^tti ?uiaii^is based on the departmentally z-scaled FYA and GRE variables 
(Z^ and Zgre) provided infontBtiDn regarding_ the average standing of irenters 
of regional subgroups on these variables within their^espective departifents 
of enrollment . A parallel analji^is based on Fffi (as cotputed and reported by 
departments) and GRE scores (on the 200-800 scale used for repbrting) pro- 
vided information regarding the average standing of members of the regional 
subgroup on these variables without regard to their departments of enrollment . 

In deciding qpon this approach, the following factors were taken into 
account : 

o Ihe regional subgroups differ^ markedly in size (from N = 17 for Africa 
I, to N = 643 for Asia II). The regional mix in mar^ of the irriividual 
departmental sairples, median N = 12, could hot be representative of the 
regional mix in the total sanple. 

o >kDreover, members of the rei^ctive regional subgroups were not neces- 
sarily enrolled in comparably "representative" arrays of departirents with 
re^ct to (a) field arKii/or major area (engineering versus ecOTiotdcs or 
engineering versus matiy science^ for example), (b) degree of selectivity 
(level of GRE scores), (c) grading standards (level of grades awarded 
relative to level of CSRE scores) , and so on. 
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In sucdi circumstances, obsecved riegidhal-group differences in average 
TOthinHfepartJrten standing will reflect to sone extent factors associated with 
tJie nonrandoin dis trihwtion of regional meriibers anohg the various departments. 

ftccordingiy, it was ccaisidered irtjportant to analyze not only the relative 

witiiir>K3epartraent standing of subgroi^sjxit^a^ their relative starKiing with-^ 
out regard to their departments of enrollment. It was reanoned that parallel 
findings vrould permit stronger conclusions about regional differences in 
academe perfdnnan than would be possible if cotparisohs were based solely 
on 2-scaled data. 



usefulness of_this_approa^ is contingent, in part, on the degree of 

conparability between the regression of FXft on quantitative and anaQ.ytical 

ability, scaled scores for all ESL students without record to their de^rtnents 
of enrollment, and the pooled wi thin-department regression results for the 
sane combined saitple (that is^ the regression of Zfya on Zgre variables). 

^ nake a _determination regarding this question, a_irultiple regressical 
analysis based can the Fm as^^rted by departnents and GaRE variables on the 
familiar 2G0-8G0 scale was conducted for the total sairple (N = 1,213) of ESL 
students. 3ie results obtained closely, paralleled results of the regressicxi 
of Zfya on Zgre scores in this same sample.* For example: 

o In the total sanple analysis, siitple cor re^ of GRE A, and V with 

FYh were .34^ .28, and •ll^^espectively, as con|)ared to .31^ .28, and ,10 
for the pooled withih-department analysis. 

o Only quantitative, and analytical scores had significant wei^ts \^en Fffi 
was regressed on Q, and V in the total sample analj^is^ standard E>ar- 
tial regression coefficients for Q and A were ^268 and •144, respectively, 
in tiie analysis jdUiout re^rd to department of enrolliientr as cdtrpared to 
.238 and .176 for Zq arxJ Za in the pooled wi thin-department analysis. 

o For_the total sample analysis, R = .36 for the Q,A coiposite, as catpared 
to R = .35 for the Zq^Za ccnpbsite. 

For the z-scaled within-Hiepartment data set, means were cqtiputed, by 

region, for Zf^^ Zq, Za, Zv, and Z'i^, wtiere = predicted Z^ = .238 

Zq + .176 Za. 

Regional means were also ccipated for F^, GEE-Q, ^^A, ^^V, and Fm' , 
v*iere FXA' = predicted FXA = .D013 (QJ + .DDCB (A) + 2.2831, a regression 
ec^tion based on the tdt2G.^^-san|3le analysis allijded to above. These means were 
expressed as deviations f ran the grand mean for all quantitative students 
without regard to department of enrollment. 



* Trends in f irdings of regression analyses conducted separately for engineer- 
ing, matlyscience, and econqndcs sanples were similar to those reported here 
for the combined sample of students frcm quantitative departments. 
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Findings 

^feans of groins on the original F2A and (3RE variables are shov^ in Table 
15 shows (a) these ireans expressed as deviations from the grand 
means for all students mthout regard to dega (b) correspcpdihg 

regional means on the dej»rtmentaiiy z-scaled variables , in both tables^ 
regions ate listed in descending order with reqpect to mean rm. Firaiings for 
the saitiple of English-native-language (ENL) students are included for perspec- 
tive. 

Mth regard to differ^^ ampng regional groups in "average academic 

performance," several trerKis are noteworthy: 

o Itie ranks of regional groups in tenis of me^ F5a correqpmied dL^ly to 
tipir ranks in tetins of neah Excluding Jtoierica il, Qie rarics for 

ESL groqps on the two indices of ac^Janic standing corresponded perfectly. 

o At one extrj^, students from the two Euri^an contingents earned grades 
raging about 3.6, ard they were in departrent-level sanples in vfriich 
they tended to outperform other ESt students. At the other extrere, 
students from the two African contingents and the. Mideast earned grades 
averaging adxait 3.3, and they were in departirint-level scotples in \^ich 
they tended perform at a lower level than other ESL students. 

o The two large contingents from Asia {accenting for some 68 percent of all 
foreign stijdents in the study sanple) earned grades averaging approximate- 
ly 3.5^ corresponding to the. grand mean for all sttxJents, and their 
z-scaled means were approximately 0.0. .By inference, Asian stt:dents .tend- 
ed to preside a "coratori elCTieht" in the regional mix of the 
respective departrent-le^l_san5)les; their aicademic performance tended to 
influence both the departmen t-level sanple Fm t mans and the total sanple 
F2A mean . " 

o Effects associated vdth department of enrollment are illustrated in the 
data for students frc3m America II. "Iheir FXA mean, of 3.44 placed them 0.12 
standard deyiatims below the grand mean for all students without regard 
to department (mean Fm = -0.12) , but their itiean Zf^ was 0.11^ indicat- 
ing that their F^s tended to be higher than the general ESL means in 
their respective departments. Ihus, ty inference, these students tended to 
be f ran department-level ESL saitples with conparativeiy low mean FYh. 

It is also noteworthy that on both indices of "relative academic starr- 
ing," the average standing of students frdm Category I countries (with ESI> 
corKiucive backgrourris) was similar^ J^^ from Category II 
countries (with ESL-resistant backgrounds)^ These background differences are 
reflected in regional means on the verbal measure and on the analytical 
measure: the vei±al and analytical means of Region i stuterts were hi^r 
than those for Region II ESL students. 

Data for the contingent of EMj (Engl ish-native^language students J suggest 
that their academe perfornence ter^ to be roughly colorable to that of the 
typical ESL stixient in their respective departments. Their mean FYh, 3.54, 
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Heans of Regional Groups .£iii.Be9ulafly Scaled Fffl and (Se Scores: 
Pooled Data for 1,213 Students io 86_aigiB£erJng, Math/Science, 
and Econooics Depactncnts 



Table is 



Region 


N 


m 


QtE-0 


WGrTl 


WUrV 


Europe I 
&rope 11 


62 

78 


3,63 
3.5/ 


696 
681 


569 
497 


447 
366 


Alia II 
Asia I 


643 

188 


3.49 


709 


523 


352 

soo 


Anerica II 

Kilca-ii 

KideasE 


86 
13 
9B 


3.44 
3,34 
3,32 


628 
609 
662 


478 
415 
466' 


404 
324 
344 


Africa! 


17 


3.31 


639 


510 


432 


All "I't 
All "11" 


273 
840 


3.50 
3.51 


697 
703 


530 
483 


482 
35? 


ESI fttal" 1213 
Standard Deviation 


.3.49. 
(0.411 


698. 
(81) 


492 

(106) 


384 

(106) 


Foreign ENL 


31 


3,54 


726 


610 


539 



Note. Regions are listed in descending order with respect to Man m. 

* includes data for six Awtica I students. 

** Includes Nideast and I-iq students not classified ty region. 



o£..Fo?e gn^studentfi flfl.riis.aia (SE variables, Region, Expressed 
1^' »s Dev iUons jPfon the Means. of. llieif Respective Deparfets of 
'^f^ wnt and (bl as Deviations. ftM.GraDd.8BaflS. for All 
Students! DaU for All Quantitative Departments 



Region 

Europe I 62 

Europe 11 78 

Asia II 643 

Asia i 188 

Siiiecica.II 86 

Africajl 17 

Mideast 98 

Africa I 17 



All T- 

All 'ir 



273* 



S(fya| m 

(al (b) 


Z(q)(SE-Q 

lal (b) 


2(s) O&A 

(a) (b) 


z|v) 
la) 


G8E-V 

(b) 


0,27 0,14 
0,22 0,08 


-0.16 -0.02 
•0,31 -0,22 


0.42 0.73 
-0,02 0,05 


0.43 
-0.16 


0.59 
-0.17 


.0.02 fliflJ 
-0.02 0.00 


0.24 0.28 
0.05 0.12 


-0,04 -o:o7 
0,22 0:29 


-6.25 
0.88 


-0.30 
1.09 


0.U ^.12 


-0.42 -i).86 


0.07 -0.13 


0.23 


0.19 


-0'.I6:c:37 
-0.34 -0.41 
-0.47 -0.44 


-0.72 -1.10 
-0,52 -0.44 
-0,52 -0,73 


-0.56 -0.73 
-0.23 -0.25 
0.02 0.17 


-0.52 
-0.28 
0.22 


-0.57 
-0.38 
0.45 


-0.00 0.02 
0.04 0,05 


-0.07 -0.07 
0.09 0.01 


0.24 0.36 
-0.05 -0.08 


0.72 
-0.20 


0.92 
-0.25 


0.00 0.00 


0.00 0:00 


o;do o:o9 


m 


o.oi) 


0.08 0.i2 


-0.09 0.35 


1.19 1,20 


0,84 


1.46 



Foreign M II 

iWe,_Rfigipn5 are.lls£ed in desceiflirig order with respect to m m, M- 
«Ha) en r es arej8ans_oiL _departiiientally i.sc»led variable, indicaHno 
average witliin^epattienU ^ 
the wrage^within^epartment Ftt of students free Europe i was 0:27^ 
dardieviate above the wans of their resnective departjentsj their 
average__with n-departlht standing for quantitative ability was relatively 
.wer iBfiMi. ? q! - -tl6J,. :they.were above average ^by P.42-Btandard units) 
.ftr .«ia^ytl.«.l..al)lUty, mi,., ani.to.on. caa (6) entries represent 
««^_^of,Wf .™..(A.-4,:B.':3,:.. ,_:XOI.afld I3lE.scSled- scores 
expres6ed_as^deviat e ns fcoa grairi mans f or all students with out rmrn to 
departoBnt of...enr6njient, in total- saapie standard deviation units, rot 
exaaple, the^ average: Effi Jot Eiirope. I students (3.63) -ws -apoxiBately 0.14 
standard deviat ons (s.D. .:0.41J higher thaii that fbrall^students grand 
mean na - 3.49), their (21EH) wan 1696) was spprox^ standard > 
viatlons^.D.. 81) below thejrand aean l^ fM. ali students, and so w- 
For the ^lisfr«tiv(hlinguage (BJL) students, neans are scaled relative to 
data fot^ESLstudents. m students earned grades averaging M 0.12 stan- 
dard deviations, better.than average for foreign ESL stuients in their resnec- 
.tlve_departiie_ntvtheir_!S8E_ veibal.scotes averaged 1.46 standard deviations 
above departaent (ESL) means, and so on. 

♦ lncludes.6.ASrica i students,- ** Includes Mideast and two students with- 
out data on country of citizenship. 
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placed tfem 0.12 standard xmits above the grand nean f or all ESL studants and 
tteir itean - 0.08 (z-scaled relative to tte mean for ESL students^ in 

tlieir respective departmentsj indicated similar, relative witiiin-departnent 
standing. Et€i students had the highest standing of any group on QSE-<3 (laeeffi « 
726, 0.35 standard dteviatic^ the grand mean). However > their Zq neah 

vas -6;09, indicating^lic^tly lower than average relative standing within 
their respective departments. inference, the students tended to be from 
selective cfepartnents that enrolled ESL (and otter) students with very hi^ 
quantitative scores. 



Gbsexved versus Predicted Criterion StanlLng of Fegidrial Grbtps 

_ Table 16 shc^ the observed means of regional gro^js on FSV and on ZJ^ 
aixl the cbrrespSdihg predicted means. F^' (predicted F5a) is based ot the 
regression of FXA on GREH2 arx3 (SESA in the total saitple; (predicted 
Z^a) is ba^ on the regression of Z^ on Zq and Za in the same sample. 
and Fpi'_ means are expressed as deviations from the grand mean in standard 
deviation units (grand mean « 3.49, S.D. = 0.41)* 

Figure 1 points jjp the generally ^rallel nature of findings from the 
across-d^rtments arid the withinrdepactments analyses. In each of tte three 
franeS/ i^jibgrotgs are ordered from left to rj^t oh mean Fih . rfean Fffi and 
mean Fffi', from -U^ across-^eg^rtmente ana^ shown in the. top left 

fraite, ^ and mean Z^i^ and mean Zfya', from tiie witM analysis, are 

shown in the bottom left frame. Mean residuals (mean of "db^rved minus pre- 
dicted performance" values) from the across-dejpartitients analysis and the 
witMnHdepartment analysis are plotted in the top right frame. 

o Ihe projEiies of mean residual values are cjiite siinilar. European stxi- 
dehts, with ger^raliy hic^er criterion standing, tended to have hi^er 
observe than predicted standing, and stirients f rem the Mideast and Africa 
II, with generally lower criterion standing, tended to have lower observed 
than predicted standing. The ire was noce txmistenc/ between observed and 
predLcted_ standing for the remaining groc ;:p^_(ENL, Asia I^ ^ Asia II with 
higgler observed criterion staixifing, and Africa II with lower criteria 
standing). 

o Only for students from 'v^ierice 'vere across-^ie^rtr^nt r6:$»^iLts a 
ably different from witl> v^-det^^^ij^ncnt results. In the acrcor; -departments 
analysis, observed rTdA ai.r: predic tiid FSA values for these :;;:udents were 
similar— both were below vjrie gra;':-J mean (FXA_ « 3.49) ±cr all students, 
without re^rd to deparbreiAt of enrollit^iit. L::wever, this givA^n .enjoyed 
coKparativeiy higgler ave!.age \at±4rw>.partm£M:. standing (mean 'zfya was 
0.11J, v*iile their average j- '^dict^?'' r 'dilative v^LiidnHdepartitei.c standing 
was lower (mean Z'^ vc^ --'.'^^ A^di a pat^-\:'n of findings reflects 
effects associated with ti:e iJe- "rec :,:al mix" andl/cr crading 
standards of the parti ci>Tar r:^'.\^.^ in ^/ikirh these sttiderits. were 

enrolled, as indicated eariv.e;:. 
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Table 16 

Grand Mean FYA and Sean FYh' as Co^ red to Wi thin-Department Mean 
Zfya and Mean 2'fya for Regional Groups: Pooled Data for 
All Quantitative DepartHKnts* 



Region 



N 



Mean 



Mean 



As 



Mean 



Mean 







FYR. 


FYA' 


from grand mean # 


Zfya 


*J ijf CI 










FYA 


FYA' 


Europe I 
Europe II 


62 
78 


3.63 
3.57 


3.53 
3.47 


0;34 
0.20 


0.1b 

-0.05 


0.27 
0.22 


0.04 
-0. 08 


Asia II 
Asia I 


643 
188 


3.52 
3.49 


3.51 
3.52 


0.07 
0.00 


0.05 
0.07 


u . uz 
-0.02 


0.05 


America II 86 
Africa II 33 
Mideast 98 
Africa i 17 


3.44 
3.34 
3.32 
3.31 


3.39 
3.32 
3.42 
3.42 


-0.12 
-D.37 
-0.41 
-0.44 


-0.24 
-0.41 
-D.13 
-0.17 


b.ii 

-0.18 
-0.34 
-0.47 


=0.0^; 

-0.27 
-0.16 

-0.12 


All "I" 
All "II" 


273 
840 


3.50 
3.51 


3.51 
3.49 


0.02 
0.05 


0.05 
0.00 


-0.00 
0.04 


D.v3 
0. 01 


ESIi Total 


1213** 


3.49 


3.49 


0.00 


0.00 


0-00 


b.dd 


ENL 


31 


3.54 


3.59 


0.12 


0.24 


COS 


0.13 


Ndte. Regional qroups are 


in descend 


ing order 


with respect 


to mean 


FYA. 



* FYA - regularly scaled FYA; FYA' = predicted FYA, using .0013 (Q) + «p006 

(A) + 2.2381, an equation based on the regression of FYA on scaled 

scores for the coittoined sanple of ESL students from quantitative depart- 
ments . 

Zfya ^ departmentally z-scaled FYA;_Z'fya = predicted Zfya, using .238 
2g__+_*i7§_^Za ~ p. 00, an_ equation based on the regression of ^fya on the 
departmentally 2-scaled GRE predictors for the same combined sanple of ESL 
students from quantitative departments. 

# The observed and predicted FYA means for regional groups are expressed 
here as deviations from ti-^e grand FYA mean (ESL total mean = 3.49) in total 
sanple standard deviation units (S.D. = 0.41). 
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ACROSS -PEPARTMENTS ANALYSIS. BASED ON DATA POOLED 

_ WITHOUT _DEPARTME^^^-IJEVEL STANDARDJ2ATION 
Mean FY A and mean predicted FYA (FYA') computed 
without rccard to department of enrollment 

3.9 




E-1 ENL As-1 Af-2 Af-1 

e-2 A3-2 _ Am-2 _ M-E 

ReQionoK oubgroupO- ordered from lefl to right 
(higher [3.6] to lower E^*^3) on meon FYA 

• FYA* - .0013 ORE-O + .0006 dRE-A 



TRENDS. IN **OBSERVED-MINDS-4>REPICTED ^PEREORMANCE*^: 
RESULTS BASED ON THE ACROSS- DEPARTMENTS ANALYSIS 
(TOP LEFT)^ COMPARED TO RESULTS BASED ON THE 
WITHIN- DEPARTMENTS ANALYSIS (BOTTOM LEFT) 

H FYA - FYA' 
o Zfyd - Zfyd' 







i:o 






.8 


cn 






;c 




.6 






C 

o 
trt 




.4 


_*> 


*c 

_i? 


.2 


fo 

■XJ 


"P 
o 


0 


Oi 


■o 




Q. 


c 
o 


-.2 




u> 


-.4 












-.6 






-.8 






-1.0 




■1 ENL A3-2 Af-2 Af-1 
1 _ E-2 Aa-I Afti-Z M-E 
RegionaJ eubgroupa ordered from loft to ^*ght 
(higher [3.6] to lower [3.3]) on meon FYA 



imHIN -DEPARTMENTS ANALYSIS. Bi^ED ON PEPARTMENTALLY 
STANDARDiZEp (2-SCi^ 
Averages Telaiive atandizi|( (Zfya) veraua average 
predicted relative standinf (Zfya*) * 




ENL A9-1 Af-2 

E-2 A9-2 Am-2___ M^E 

Regional subgroups ordered from left to right 
(higher [3.6] to lower ^3.3]) on meon FYA 

* Zfyo' - .238 2(q) -h .176 2(o) 



Ftgurtt 1, PIndinea bas^cl on analraisL of dats Mroas 
doptfrtiiiohts vorsus flndlho* basod on 
analysis of data within dopartmonta 
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Generally speaking, the f indings reviewed in this section indirate that 
there v^ere differences aiSaig the regional sul:^rot?)s in level of ac^temic per- 
foramce. JChere general tencJency for su^roips with hitler average cri- 

terion perfonnancj to have hitler scores on GBE predictive cotpbsites. Hbw^ 
ever, tte findings, also suggested the possibility of predictive bias for 
regicml subgrotps within the forei^p ESL stirient population, Fd^ example, 
Eijrcpeah students tended to have scinev*iat higher relative standing on nean FSA 
and itean Zfya than esq^ected f ran the correspcanding sets of <SlE measures 'i^iile 
tiie cpE»site was for students from the Mideast eund Africa. Ihese partic- 

t43?_fiJ?3ings^hould ^be viewed primarily as working hypotheses for future 

researdi concerned specifically with the assessment of predictive bias. 

In the ineantime> departnents may assess the rele^^nce of the trends 
revealed in this exploratory analysis by observing, the typical E^ttems of 
academic performance of students fron various regional subgrot^ps sudi as those 
defined for this stucfy. 
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GRE and PSA Means and Standard Deviations, and GRE/FXA correlations, for 
Department-Level Sanples of Foreign ESL Students, by Field 
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®E arid rav Means and Standard Deviations, and GR^/Fa dorrelatiOTis, for 
Department-Level Samples of Foreign ESL Students, by Field 



Mean 



Standard 
deviation 



OFPAKTMiENI/ 
SCHlJilL Nit , 



6A 
66 

6B 

6a 

68 



1^ 
2^ 
30 

*>_^ 

65 



66 TCrAt 
4tt ENGIN 

APPt lEO MATH 

54 - 28 
54 TOTAC 

STATISTICS 
59 ? 



7 

14 
20 
24 
IQ 

13 
10 
115 

702 



59 
59 

59 



7 
1 ^ 
24 
28 



59 TOTAL 
CMEHISTPY 



62 
62 
62 
62 
62 
62 
62 
6Z 
67 
62 



24 

20 
33 
34 
36 
41 
65 
67 
92 



62 TQTAt 

MATHEHATICS 
72 13 
72 24 
72 34 
72 3 8 
72 TOTAt 



9 
II 
15 
12 

7 
54 



It 

Id 

26 

13 
5 

10 
5 
6 
9 

16 
tit 



R 
15 

5 
II 
3^ 



EVA 



3. 77 
3.40 
S.67 
3.64 
3.67 
3.40 
3.47 
3*66 
3.57 

3.51 



1.53 
3.53 



3. 72 
3.71 
3.48 
3.42 
3.39 
3.54 



3.^,3 

3. :4 
3 .04 
3.17 

3,51 
i,69 

3.42 
3.<> 
3.49 
3.4H 



3.87 
3.32 
3.50 
3.55 
3.52 



GftE-V 



432.9 
3B7.1 
340.0 
317.5 
^91.0 
35«.8 
3 60.0 
4iB.O 
368. 

379.7 



208. d 



408,'^ 
2e4.i 
37U.O 
3J7.5 
374. J 
352.4 



350.0 
352.0 
3 55.8 
i li.8 
37d.d 
314.d 
388. d 
33'. 0 
42 7. B 

3na. t 

360. 1 



3 56.2 
334.7 
372.0 
334.5 
343.8 



ORE -6 



751.4 
726.4 
724. 5 
70*.. 2 
751.0 
685.9 
693.8 
71 1.0 
714.5 

709.5 



6*30.0 



02.7 
709.3 
670.6 
652.9 
693.3 



ZIP-9 
664. b 
707.7 
660.8 
69?. b 
65 8.0 
630.0 
628.3 
705-6 
610. d 
67t.4 



703i7 
634i0 
752.0 
650.0 
66 7.9 



ANAl Y 



521.4 

475.5 
455.0 
534.0 
453.5 
476.9 
536.0 
48 8.5 

496.5 



470.0 
47d.d 



52 S 
462.7 
496^0 
458.3 
42 7.1 
477.2 



503.6 
402.0 
455. a 
426.5 

439. b 
472. b 
410.0 
500.0 
453. i 
455.0 



463. / 
396.0 

43?. 7 
^37.9 



0.31 
d.49 

d.id 

0.41 
D.3I 
0.39 
0.67 
0.36 
0.41 

0.37 



0.54 
0.54 



D.3i 
D.25 
0.41 
0.43 
0.35 
0.36 



0.28 
0.61 
0.3 0 
0.4 7 
0.20 
b.29 
b.52 
b.26 
0.26 
b.4 7 
0.37 



d.25 
d.4 7 
0.29 
D.36 
0. 17 



GRF-V 



107.7 
9d.9 

7d.d 

82.4 

ao.s 

10B.7 
55.2 

131.2 
87.7 

95.8 



48.2 
48.2 



88.8 
49.1 
74.4 
113.5 
107^4 
84.6 



52.0 
124.6 
78.4 
76.7 
130.8 
71.2 
63.8 
76.7 
115.4 
77.0 
83.5 



89.0 
77.1 
137. 7 
63.1 
83.4 



GK F-0 



29.7 
75.6 
55.4 
95.7 
36.4 
79. 1 
52.0 
66.2 
67.3 

64.7 



43.6 
43.6 



99.7 
66. d 
60.5 
59.5 
105.3 
73;8 



59.2 
75.0 
67.4 
64.4 
49.2 
70.5 
124.7 
111.4 
57.5 
lb4.9 
76.0 



61.6 
85.6 
42.7 
63.1 
74.5 



ANALV 



88.6 

iba.4 

8|. 3 
97.9 
91.2 
Ut.9 
-67.6 
lOR. 3 
94. 7 

95.3 



76. 8 
76.8 



147.4 
86.6 

ID9.3 
60.9 

166^6 

107.7 



86.6 
130.1 
68.9 
II 3. 3 
71.3 
73. 7 
166.6 
66.3 
74.2 
ti6. 7 
94.9 



168.9 
109.0 
99- 3 
103.9 
118.6 



Gbrrelation 
with Fffi 

GRF-V ANAty 



0.533 
b. 36 1 
0.266 
-.135 
-•6|8 
d.2d2 
-.138 
0.535 
0. 104 



-.272 
-0.272 



o.r>4 

-.119 
D.5D7 
0.206 
0.036 
0. 189 



-.243 
0.424 
0.184 
0.071 
-.723 
-.111 
0.013 
0.208 
-.124 
-. b64 
0.bl2 



-.d65 
-.d98 
d.7l 7 
-. I9d 
-0.013 



-.597 
b. 095 
b.<il2 
b.563 
b. 200 
0.004 
d.567 
0.72 5 
0.347 



0.457 
-.145 
0.588 
0.255 
-.304 
0.375 
b«34 7 
d. 763 

d. 3dd 



0.114 0.269 d.278 



-.178 
-0.176 



0.45B 
0.500 
d.275 

-.id4 

0.761 
0.330 



0.506 
0.666 
0.401 
0.365 
-•375 
0.654 
-.019 
0.430 
0.00 7 
b.266 
0.353 



0. 66 0 
d.550 
d.5 74 
d.644 
0.602 



-.458 
-0.456 



0.4 74 
-.127 
b.6 38 

b. 55b 
d.563 
d.425 



0.447 

0^666 

-;i77 

0.542 
r.646 
0.323 
-.026 
0.492 
0. 104 
0.205 
0. 190 



0.220 
0.234 
b.480 
b.246 
0.266 



Appendix A^l, eontimieci 



Page 3 of 4 pages 



GRE and FYA Means and Standard Deviaticxis, and GR^/Fffi Cbr relate for 
Department-Level Sanples of Foreign ESL Students, by Field 
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0.268 



125.6 


60.4 


57.7 


097 


0.060 


0.170 


52.1 


71.3 


9 5. 6 


0.669 


0.359 


0.326 


55. 1 


97. I 


8 5.0 


b. 352 


0.079 


0.497 


56.5 


41.8 


8 5.5 


-.225 


0.041 


0.600 


98.6 


lid. 3 


73. 6 


-.252 


0.631 


0.692 


5 5.3 


121.9 


«9.6 


d. 351 


-. 329 


0.157 


109.0 


103.3 


104. 8 


d. 338 


d.465 


0. 164 


119.1 


40.2 


117.2 


0.495 


d.278 


0.392 


61. S 


68. 3 


103.9 


-.176 


d. 11 5 


0.430 


136.0 


59i9 


100.8 


-.080 


0.632 


-.190 


89.8 


87.7 


9 4.3 


0«210 


0.313 


0,282 


89.8 


87. 7 


94.3 


0.210 


0.313 


d.282 


95.0 


69. 1 


9 5i9 


0.097 


0.311 


d.2T5 
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(S(E and FYA Means ard Starflafd Deviations^ and O^^/T^ Correlations, for 
Departnerit--Level Samples of Foreign ESL Students, by Field 



Mean 



Standard 
deviation 



Correlation 
with FYA 



SCnniiL NO. 


N 




r.RF-V 


OR 1-0 


ANALV 


FVA 




GRF-0 


ANALtr 


MiC^f.HiijLubtr 






















6 


3.43 


41 0.0 


691 .7 


S4b.d 


0.46 


120.5 


83. a 


97.4 


1 fiirst 


6 


3.43 


41U.0 


691.7 


S40.0 


0 .46 


120.5 


83.8 


97.4 


XGKICUI tORAl 


F - 


















31 7 


7 


3.?6 


3)2.4 


514.3 


417; I 


0.44 


39.0 


174.7 


112. 1 


31 33 


16 


3.18 


340.1 


503.7 


361.9 


0.4a 


76.0 


119.0 


78. a 


31 TOTAt 


23 


3.?l 


343; 5 


S07.0 


3 7B. 7 


0 .47 


6«.a 


136.0 


a9.o 


BliJCHeHlsittr 




















34 7 


a 


7.96 


453. 7 


653.7 


51 T. 5 


0.47 


110.3 


72.1 


104.4 




11 


3.0? 


36y. I 


676.4 


469.1 


0.6 7 


83.0 


55.9 


95.1 


34 TOTAL 


19 


2.99 


404.7 


666. a 


489. 5 


0.59 


94. 5 


62.7 


9«.a 


BinLncy 




















3^ 49 


7 


3.35 


371«4 


612.9 


504. 3 


0.59 


61 .5 


96.6 


55.3 


35 TOTAL 


7 


2'. 35 


371.4 


<»12.9 


504.3 


0.5 9 


61 .5 


96.6 


55. 3 


810 SCI 


55 


3. IS 


375.5 


595.8 


450. 5 


0.52 


80.7 


100. b 


89. 1 



EDUCATION 
85 2 
85 7 
85 24 
85 33 
85 IllTAL 

POLITICAL SCl 
9? 7 
9? TfTAL 

SOCIAL SCI 



26 
17 
?l 
I? 
76 



3.2? 
3.56 
3.45 
3.6d 
3.43 



421 .9 

323.5 
206.2 
334.2 
351. 3 



54 3. i 
512.9 
562.4 
488. 3 
533.0 



432. 3 
37J.5 
409.0 
405.8 
408.6 



d. 64 
0.17 
D.IS 
0.36 
0.16 



i?7.2 
53.1 
48.7 

II 3.4 
86. 8 



134.9 
175.3 
141.7 
165.2 
150.6 



101. 3 
89.0 
87.3 
71.8 
90.0 



I I AL 



13S3 3.48 362.0 684. 3 



485.6 



0.37 



93.9 



75.3 



95.4 



r.Hf-v 



-.751 
-0.751 



-. 726 
0.512 
0.135 



0.245 
^.588 
-0.23tf 



0.664 
0.664 

-0.023 



0.374 
*.0i8 
6.020 
0.430 
0. 197 



GRF-0 ANACI^ 



9 


3.57 


353.3 


611.1 


464.4 


0.17 


85.4 


122.1 


11 6.6 


0.727 


9 


3.57 


353. 3 


611. 1 


464^4 


0.17 


85.4 


122.1 


118.6 


0.727 


85 


3.4^* 


351.5 


541. 3 


414.5 


0.34 


86.6 


U7.6 


93.1 


0.253 



0.102 



369 
369 



0.709 
0.043 
0.273 



- . 095 
-.155 
-0.129 



-.384 
-0.384 



0. 061 



0.251 
0.004 
0. 122 
0. j33 
0. 142 



-.097 
-0.097 



0.116 
0.288 



-.569 
-0.569 



0.7J8 
0.603 
0.635 



0.075 
-.260 

-d«ii9 



^.641 
-0.641 



0.081 



0.080 
0.00b 
d. 1 30 
0.681 
0. 172 



0.282 
0.282 



0. 184 



0.262 
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Staple CorcelsCIon of GRE-PredlcCors-wich FYA for Foreign 
ESL Samples, &y School snd DeparCneiiC 



School Departaeat 



02 Chem Engineering 17 

-Civil Engineering 32 

Ihdusc Ehgliieerlhg 12 

Stsclstlcs 9 

_Pby9lc8 6 

Economics 10 

Educstlon 26 



07 Chen Engineering 9 

Civil Engineering 30 

.Elect Eiiglheerliig 33 

IiiduiBt Ehglheerlhg 12 

Mech Engineering 7 

Stsclscica 11 

Chemistry 11 

Physics 13 

Computer Sci 12 

Economics IS 

Agriculture 7 

Biochemistry 8 

Educacidii 17 

Pollticsl Science 9 



^0 Chem Engineering 14 
Elect Engineering 31 



13 -Elect Engineering 14 

Induit Bhgiheering 9 

Hech Eiigiheering lA 

MachemaCics 8 

.Physics 8 

Economics 12 



Correlation of GSE predictor 





with FIA 






GSB-Q 




.25 


-.92 


.37 


-.27 


.14 


.21 


.40 


.42 


.52 


.13 


;46 


.47 


-.3A 


.54 


;34 


-.10 


.08 


.17 


.17 


.25 


.08 


- 18 


.56 


.69 


- ;i7 


.12 


.13 


;ii 


.45 


.36 




.68 


.61 


;i53 


-.60 


.46 


-.12 


;50 


-.13 


-.24 


.51 


.45 


.32 


.48 


.43 


-.12 


.42 


.24 


.67 


.36 


.33 


-.73 


.71 


.71 


.2$ 


10 


.08 


-;oz 


.00 


.61 


;73 


-.10 


.28 


-47 


.48 


.47 


.32 


.29 


.28 


.45 


.47 


.39 


^58 


.67 


.48 


;38 


;io 


-.14 


-.06 


.66 


.22 


-;67 


-.10 


.34 


.35 


;08 


.50 
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GRE/FYA correlstion, by school and department « continued 
School Departaeat N 



CorrelAtiOQ of GRB predictor 
with FTA 







GttE— V 




GRE— i 


*~ _ V!j^^> mUq ^iieiSLl 


0 


. 23 


.73 


. 13 


Elect Engineering 


31 


. Uj 


.3j 


• 31 




20 




.61 






15 


CI 


.20 


.64 


Computer Science 


? 


--05 


.54 


.06 


Economics 


6 


— . 22 


.04 


.60 


19 Elect Engineering 


10 


.23 


.05 


.84 


24 _Cheo Ehgirieerlhg 


5 


.55 


-.13 


.78 


Civil Engineering 


42 


-.02 


.11 


.06 


Elect Engineering 


19 


.08 


.52 


.23 


Indust Engineering 


13 


.19 


.45 


.38 


Hech Engineering 


24 


-.14 


.56 


.26 


Statistics 


12 


.21 


-.10 


.55 


Chemistry 


10 


.42 


.67 


.67 


Mathematics 


l5 


-.10 


.55 


.23 


Computer Science 


21 


.37 


.37 


.63 


Economics 


11 


-.25 


.63 


.69 


Nicrcblology 


6 


-.75 


.37 


-.57 


Education 


21 


.02 


-12 


.13 


28 Applied Mathematics 


5 


-.27 


-.18 


-.46 


Statistics 


7 


.04 


.76 


.56 


Chemistry 


26 


.18 


.40 


-. 18 


30 Chem EngineeflDg 


30 


-.06 


.64 


.60 


Civil Engineering 


13 


.34 


.79 


.41 


Elect Engineering 


12 


-.05 


.76 


.43 


Mech Engineering 


10 


-.62 


.20 


-.30 


Physics 


5 


.04 


.82 


.58 


Computer Science 


l2 


-.33 


.31 


-.24 


Economics 


11 


.35 


-.32 


.16 


32 Economics 


48 


.34 


.46 


• 16 
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... 

GRE/FYA correlations, 


by school 


and department y continued 




School Dep^rcaeac 


N 


Correlation- of CftK predictor 








viEH rrx 








GRE-V 


GgE-q 


_ 

GEE-A 


33 Civil Engineering 


11 


-.61 


.50 


-.50 


Elect Engineering 


36 


.29 


.22 


.44 


Mech Engineering 


17 


.20 


.00 


.38 


Chemistry 


13 


.07 


.36 


.54 


Physics 


_8 


.02 


.45 


.63 


Computer Science 


16 


.04 


.14 


.46 


Education 


12 


.43 


.13 


.68 


34 Elect Engineering 


52 


.16 


.02 


.31 


CheniBtry 


5 


-.72 


-.38 


-.65 


Hacheaatics 




.72 


.57 


.48 


Economics 


5 


.50 


.28 


.39 


38 Civil Engineer iDg 


19 


.19 


-.09 


-.40 


Indus t Engineering 


25 


-.03 


.16 


.05 


Mech Engineering 


13 


-. 14 


.59 


.35 


Chemistry 


id 


-.11 


.65 


.32 


Mathematics 


11 


-.19 


.64 


.25 


Computer Science 


12. 


-.22 


-.00 


-.29 


Agriculture 


16 


.51 


.08 


.60 


41 Elece Engineering 


15 


.16 


.08 


.47 


Chemistry 


5 


.01 


-.02 


-.03 


.physics 


11 


.30 


.60 


.43 


Computer Science 


5 


-.66 


-.94 


.52 


Economics 


12 


18 


.32 


.43 
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GRE/FYA correlations by school and department, concluded 



School Departmeot 



67 



Chemistry 



Correlation of GRE predictor 
with FTA 



GRE-V 
-.12 



GRE-q 
.01 



CRE-A 

.10 



73 Chem Engineering 11 
Indust Engineering 18 



-.24 
.27 



.36 



-.26 
.36 



82 Computer Science 7 

87 Economics 8 

91 Biology 11 

92 Chemistry 16 



.54 



-.08 



-.59 



-.08 



.36 



.63 



.16 



.29 



.23 



-.19 



-.26 



.21 



Civil Engineering 


5 


.03 


-.10 


.09 


Elect Engineering 


13 


.43 


.47 


.22 


Cbnputer Science 


7 


.13 


.16 


.44 


Biology 


7 


.66 


-.38 


-.64 


Computer Science 


13 


-.19 


.47 


-.02 
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A-3 



DlsErlbtiClons of GRE Means f or DeparCmenCs , by Graduate Ar.ja 



Engineer/ 



Score 


HaEh/Scl 


Economics 


^os^lenee Soe-Seietvce All Fields 


category Q A V 


Q 


A 


V 


Q A V 


Q A V 


Q 


A 


V 


760+___ 


1 














1 






740-759 


10 


2 












12 






720-739 


15 














16 






700-719 


20 


1 












21 






680-699 


14 


2 






1 






17 






660-679 


5 i 


i 

JL 






1 






7 


1 




640-659 


6 - 








1 






7 






e20-639 


4 1 


1 






- 






5 


1 




^00-6 19 


1 2 


1 






i 


1 




4 


2 




5SD-599 


1 1 




i 












2 


2 


560-579 


2 


1 








1 




2 


2 




340-559 


3 






1 


- 1 


1 




1 


4 


1 


520-539 


18 1 




1 












19 


1 


500-519 


7 1 




2 




2 2 


1 




3 


11 


1 


480-499 


10 2 




3 






1 




1 


13 


2 


460-479 


13 2 








1 


1 






15 


2 


440-459 


7 2 




1 


1 


1 








8 


4 


420-439 


8 7 






1 




1 


1 




9 


9 


400-419 


2 14 




2 


2 


1 1 


2 






7 


17 


380-399 


1 9 






1 










1 


10 


360-379 


9 






4 


1 2 


1 






2 


15 


340-359 


12 








1 




1 






14 


320-339 


13 








1 




2 






16 


300-319 


1 


















t 


280-299 


2 












i 






3 


No* depCs* 76 




10 






5 






97 




Median 


708 488 382 


690 


493 


400 


630 490 ji70 


550 414 


334 


701 


490 


379 


No. jstiidenEs 1075 




138 




55 


85 






1353 




Mean 


705 495 382 


650 


469 


399 


596 450 376 


541 414 


352 


684 


486 


382 


General samples* 




















Non-U. S. 


652 458 364 


585 


443 


387 


543 428 382 


517 42C 


39X 








U.S. 


645 582 520 


592 


569 


498 


533 530 498 


483 496 


485 









P^P^'^'^'"^"^ '^^sg<l_og <^3P^ for a minimum of five students 

identified as npnnatiye irtglibh-speakers. Q - GRE_ qnanclCaCtve, A * GRE 
analytical,: and V - GRE vetbal. Only sEiidents with GRE scores earned after 
9/81 were Included In department samples. 

* Means for non-U. S. examinees, and U.S. examinees tested between October 
1981 and September 1982, <'lasslfled by Intended field of study. 
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Distributions o f S Catid a rd _ De v I a 1 1 on s of GRE General Test Scores for De pa r L «e n t-Le ve 1 Sanples of Foreign eJl Students In 
86 Primarily Quantitative Deoartmerits, Six Bioscience, and Five Social Science Departments 



CRE-Verbal 



GRE'Quan 1 1 tat Ive 



GRE-*Ana] y t leal 



19 


2 










19 










19 






16 


7 










18 










18 






17 












i7 






(5) 


t5) 


17 






16 












16 






(-) 


(5) 


16 


17 9 




15 


5 










is 






(-) 


(-) 


15 






14 


989 - 










14 






(-) 


(2) 


14 


79 




13 


01568 


16 








13 






<-) 


(5) 


13 


008 




12 


5606 






(0)* 


(7)** 


12 


502 




(-) 


C2) 


12 


7 




11 


25924 


626 




<0) 


<3) 


II 


150 




(9) 




II 


70123 


528-- 


10 


57845 


45689 


9 


(-) 


(-) 


IP 


05713 5 




C-) 




10 


II367 


44888 


9 


91297 






(-) 


(-) 


9 


76 




O) 




9 


08901 


51256 


8 


34599 


li557 


0229 


(3) 


(5) 


8 


23446 366 




(4) 




8 


05566 


90224 




67127 


04467 


78 


(6) 


(-) 


7 


2D561 24489 




<2) 




7 


12457 


24452 


6 


04235 


6 




(2) 


(-) 


6 


02400 11446 


68888 05667 


79 (-) 




6 


1682 




5 


60255 


552 




C-) 


(3) 


5 


03558 12294 


557 


(6) 




5 


38 






899 






(-? 


<9) 


4 


02349 12395 






4 


9 




3 


0 






(9) 




3 


0184 








3 






2 












2 


36677 








2 






Median 


89 




80 


?5 




66 




90 


142 






95 


General 


























sample# 119 




116 


12 3 




102 




131 


142 






112 



13357 89 

7889_ 

56778 15679 
4 



(2 ) 
(4 ) 
(5 ) 
(- ) 
(79) 
(5 ) 



87 



(9 ) 
(I ) 
(- ) 
(97) 
(2 ) 



89 



118 



117 



Sil^' ?''°P_^*^ f^^v^^^A^"!*. conbining^ t dlgltCs) within each row; For 

?**"P^*^»^^F_°"*^***^ "J-j^strlbutlon of sample standard d ey 1 at 1 on n _ f o r _ ORE _ gu an 1 1 1 a *: 1 y e , for samples from deparCmehCa 

without regard to size. It may be determined that there were five samples with standard deviations between 23 and 27, Inclusive 
(that Is, atandard deviations of 23, 26, 26, 27, and 27). 

* First column 6 f . pa r e hthe 1 1 ca I e n t r t iea re pr es e n t s the distribution of standard deviations for the six bioscience samples. For 
example, one aamp^*^ with verbal standard deviation of 120, another 110, and so bh. 

**_ Second _ column_pf_ parenthetical- entries represents Che distribution of s t arida rd d e v 1 a t ion s for five social science samples (four 
from education and one from political science): one science sample with a sEahdara devliitlbh of 127, and sc on. 



' These are standard deviations of scores for a general sample o f _ f o re 1 gn _GRE _ eisaml ne ea tested dur Ihg I98I-B2 , classified by 
Intended graduate major as math/science, bioscience, and social science, respectively (Wilson, 1984, Table 9). 
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Dlatrlboyo,, y^5t^n4^rd^D^vUtlon^ Scores for Depar tmen t-Level _ Sap.pl .a o f For eign ESL SEudenEs tn 

86 Prl»arlly Quancltatlve DeparCnenca, 6y Size of Sample and Without Regard to Sample Size, ReepCcttvely 



19 
18 
17 
16 
15 
14 
13 
12 
11 
10 
9 
8 
7 
6 
5 
4 
3 
2 



GRE V 



9 

01568 

259 
578 
9 

34599 

67 

04 

6 

8 

0 



Ndn 105 
Depca (27) 



19 
18 
17 
16 
15 
14 
13 
12 
11 
ID 
9 
8 
7 
6 
5 
4 
3 
2 



(27) 

GRE-Verbal 
Hdn - B9 



(27) 



(34) 



4 
5 

989 

01568 l6 
5606 

25924 626 
57845 45689 9 
91297 __ __ _ 
34599 11557 0229 
67127 04467 78 
04235 6 
60255 552 
899 

b 



is 

17 
16 
15 

14 
13 
12 
11 
10 
9 
8 
7 
6 
5 
4 
3 
2 



10-14 



GRE-Q 


GRE-A 




GRE-V 


CRE-Q 






19 










18 










17 








179 


16 


4 








15 


5 






79 


14 


89 








13 


16 




5 




12 


56- 


D2 


15 


7 


11 


246 


D 


05 7 


11367 


10 


45 


I 




089 


9 


129 


7 


2 


055669 


8 


11557 


3446 


2 


124 5 7 


7 


127 


05 6 .... _ 


024 




6 


23 


001144668888 


035SS 


3 


5 


025555 


1229 


02349 


9 


4 


99 


1239 


01 




3 




8 


3667 




2 




7 


53 


89 




81 


62 



GRE-A 



008 
7 

01235 
44888 
015 



19 
18 
17 
16 
IS 
14 
13 
12 
11 
10 
9 



Q22456778 8 
2445 7 



(34) 



168 



86 

(24) 



GRE-QuahtiEatlve 
Ndn - 66 



502 

15Q _ 
05713 5 
76 _ _ 
23446 366 
20561 24489 

02400 11446 68888 05667 79 

03558 12294 557 

D2349 12395 

0184 

36677 



GRE-V 



GRC-Q 



GRE-A 



06 

26__ 

456889 

7 

0229 

0446 778 

56 

2 

2 



82 
(25) 



35 
6 

366 

124489 
056 67 9 
4557 
457 
4 



71 
(25) 



28 

1335789 

12567889 

15679 

24 

2 



. 97 
(25) 



19 






Mdn - 


18 








17 








16 


179 






15 








14 


7 9 






13 


008 






l2 


7 






11 


70X23 


528 




10 


11367 


44888 


13357 89 


9 


08901 


51256 


7 88 9 


8 


05566 


90224 


56778 15679 


7 


12457 


24452 


4 


6 


1682 






5 


38 






4 


9 






3 








2 









95 



"«l;i.f''Lr"[e%Ur'l^w'l1^Vi^'^^ l^i^lal «gltC,)^lth BuccesBlve subsequent dl^ltXs) -Ithln e..b row. F6f 

without regard E6 size It ia. dl p t rlbut Ion f ganiple standard deviations E^>r GRE quantitative, for samples fron departnents 
Ul.. Is:Tc:„6^.^^ ""Pl" -Ith Btind.rd deviation, between ^23 and' 27. Lclu.Jv* 
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DUtrlbuclons of Correlaclona becween GEE Predictors and FYS for 86 Deparcmehc-Level Satnplea of ESL Scudenca 

in Prlnarlly Quanclcaclve Flelda 



c-?'^ 7<»rbat-v s FYA 



GRE Quanclcaclve va FYA 



ORE Analytical va FYA 



.8 




.8 


2 


.8 


4 


.7 


29 


.7 


23669 


.7 


68 


.6 


7 : 


.6 


01334456778 


.6 


b0133/'799 


.5 


0134458 


.5 


QQI24456679--- 
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Wed mean** 
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.31 
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Note. Deparcmenc^-Ievel coef^lclenca are apeclfled by combining che Inlclal dlglc (wlch decimal) In each rpwylch auccea- 
alve dIglCB In che.aame row. In cbe dlacrlbutions of correlaclonH becween GRE verbal »corea and flrac-year average, 

exaniple,_coef f Iclehta were .72, .79, .67, .50, and ao on. Daca are for engineering, mach and phyalcal aclence, 
«v^ ^ Tonomlca aamplea. 

* f dlecrlbuuton of 86 deparcmenc-level coef f Iclenca. 

** Size-adjusced averagea of deparcmenc-leyel coef f Iclenca. Theae coefflclenca Indlcace che_ relationship becween de pa rciiieh tatty 
scandardlred (r-acaled) predictor and criterion variables for 1,216 ESL atudents In the 86 quantitative departments. 
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Dlscrlbuclona of Deparcmeht-tevel GRE General TesC ValtdlCy CoefflclenCs for Foreign ESL SCudencs, by Size of Sample 

Daca for 86 Deparcmehcs In t^rloarlly Quantlcaclve Fields 



-GRE Verbal vs FYA 
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GRE Quantitative va FYA 



10-14 N - 15 plus 



N < 10 



.8 


2 






.8 4 


.7 


36 


269 




.7 8- 


.6 


367 


0344578 


i 


.6 039 


.5 


4467 


0019 


256 


.5 68 _ 




356 


22577788 


05 G 


.4 467889 


.3 


6- 


X26 


3667 


.3 449 


.2 


48 


0 


2899 


.2 23 


.1 


6 


0 - 


12446 


.1 03 


.0 


14 


5688 


028 


.0 669 


-.0 


2 


0 


29 


-.0 3 


-.1 


0038 


0 




-.1 9 


-.2 








-.2 - 


-.3 


8 


3 




-.3 - 


-.^ 








-.4 6 


-.5 








-.5 - 


-.6 


0 






-.6 5 


-.7 








-.7 


-.8 








-.8 


-.9 


4 






-.9 




.36 


.47. 


.28 


.39 




(27) 


(34) 


(25) 


(27) 



10-14 M - 15+ 



6 

0179 

0245--- 

1333357 

2589 

245 

67 

2 

35- 
669 
0 



.40 

(34) 



34 

9-: 
467 

1X36678 
013368 
36 
^6 

8 



.31 

(25) 



Dcpartnent-leveX^coefflclents are specified by coablnl^ In eacb rbw with succea- 

slve digits In the same row. In the distributions of correlations between GRE verbal scores arid first-year average 
for exampte.^coefflclents of .72, .79, .50, .53, .54, .55, .58, and so on, were obtained for deparCnerits with 
fewer than 10 (between 5 and_9) ESL atudents; GRE quantitative coefficients for samples of fewer than 10 stu- 
dents were .82, .73, .76, .63, .66, .67, 54, .54, .56, .57, and so on. 
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